Hi, Once in a while I try to clean up my tabs. First thing I do is use "merge all windows" to put all tabs into one window.

This often causes a memory clog and firefox get stuck in this state for 10-20 minutes

I have recorded one such instance.

I have tried using the "discard all tabs" addon, unfortunately, it is also getting frozen by the memory clog.

Sometimes I will just reboot my PC as that is faster.

Unfortunately, killing firefox this way, does not save the new tab order, so when I start firefox again, it will have 20+ windows open, which I again, merge all pages and then it clogs again !

So far the only solution I have found is just wait the 20 minutes.

Once the "memory clog" is passed, it runs just fine.

I would like better control over tab discard. and maybe some way of limitting bloat. For instance, I would rather keep a lower number of undiscarded youtube that as they seem to be insanely bloated.

In other cases, for most website I would like to never discard the contents.

In my ideal world, I would like the tabs to get frozen and saved to disk permanently, rather than assuming discard tabs can be reloaded. As if the websites were going to exist forever and discarding a tab is like cleaning a cache.

  • Hestia [comrade/them, she/her]
    ·
    16 days ago

    If you have over 1000 tabs... learn how to use bookmarks instead. I don't understand how you think 1000+ tabs is a feasible way of organizing.

  • Observer1199@lemmy.ml
    ·
    17 days ago

    The solution to write your own application that does what you want because your workflow is not a use case that browsers are designed for. It's not bad to wish for features but your workflow is never going to be catered for in a browser and it's both unreasonable and unrealistic to expect otherwise - hence you need to do it yourself.

    If you can't or don't know how to do that yourself, I suggest you listen to the advice everyone else is giving you. Organisation does require ongoing work and given your comments it will likely require a lot of upfront effort to change your browser hygiene habits but once you are more organised it becomes a lot easier and a lot less work to stay on top of things.

    It's none of my business but I wonder why you feel it's so important to open 500+ tabs just to buy something small online. Doing research and being informed is good but it seems disproportionate and perhaps talking to a professional might help you with that.

    • interdimensionalmeme@lemmy.ml
      hexagon
      ·
      16 days ago

      browser hygiene habits

      You used that term, and frankly I recoil a bit a this term because of the implication that it's not a deficiency of the software but that it's the users who are wrong.

      Still, I typed in the phrase into chatgpt

      And I see "reading lists" as an alternative to bookmarks (that I find to be, straight up unusable)

      So I found this reading list addon give a try.

      https://addons.mozilla.org/en-GB/firefox/addon/reading_list/

      I have a very specific use for a "reading list", which I take to be something like a FIFO stack of links. And that would be going through youtube videos.

      Putting this in case someone else is reading this thread looking for answers.

      However, it's a side bar thing, and you have to add links one at a time, can't select multiple tabs and add them

      As for opening 500+ tabs to buy a thing.

      You do know that sellers now use algorithmic pricing and often there will be hundreds of sellers for the same thing.

      Plus the price will be obfuscated with various artifices that all have to be overcome to find the best seller with the best price.

      Defeating all of that means openning a shit-ton of tabs.

      Here's an example of the process I've designed for aliexpress

      https://github.com/igorlogius/gather-from-tabs/discussions/8

      • Observer1199@lemmy.ml
        ·
        16 days ago

        You used that term, and frankly I recoil a bit a this term because of the implication that it's not a deficiency of the software but that it's the users who are wrong.

        I wouldn't say FF is deficient in this case - not being designed for your exact use case doesn't mean there's anything wrong with it.

        As for opening 500+ tabs to buy a thing.

        You do know that sellers now use algorithmic pricing and often there will be hundreds of sellers for the same thing.

        Plus the price will be obfuscated with various artifices that all have to be overcome to find the best seller with the best price.

        Defeating all of that means openning a shit-ton of tabs.

        I usually only buy things if I agree with the price it's being sold at. If I don't I will look elsewhere but ultimately I value my time more than money. Extra money can be earned, time cannot 🤷‍♂️ If you have to drive 100 miles to a fuel station to save 2 cent per gallon, are you actually saving money?

        Here's an example of the process I've designed for aliexpress

        https://github.com/igorlogius/gather-from-tabs/discussions/8

        So it's a script generating all the tabs?

        • interdimensionalmeme@lemmy.ml
          hexagon
          ·
          16 days ago

          No, I have to setup all the tabs in just the right way. Then for each tabs it gets the price and shipping information I paste that into excel Combine the total together and sort with ascending price Then I repeat that for every quantity value for 1,2,3,4,5,7,10,15,20,25,50,75,100 Then I find the minimum quantity to get the best price.

          This is because if you go to the website and just ask "order by price" it either hides most results, or straight up lies and still place them out of order. It also lies about the shipping cost. But it can't lie on the last page before clicking buy.

          I expect the internet to continue becoming more deceptive and manipulative in this manner, my method is almost not good enough. If my tools don't continue to evolve it will simply become impossible to find the best price for anything. It will all become an endless maze where they measure how much mental stamina you're willing to waste to save another dollar. At that point the price of things will become whatever the maximum you individually will bear.

          • Observer1199@lemmy.ml
            ·
            16 days ago

            Not sure what your coding level is but you could interact with and scrape the sites with python. I'm sure other languages have similar frameworks.

            Even if you aren't very familiar and don't know any pythons, it's a good one to learn and though it could take a while to learn enough to do what you want, you would be more motivated to figure things out and it would save you a lot of time (and money) in the long term.

            https://realpython.com/modern-web-automation-with-python-and-selenium/.
            https://www.projectpro.io/article/python-libraries-for-web-scraping/625

  • Red Wizard 🪄@lemmygrad.ml
    ·
    edit-2
    16 days ago

    Have you tried increasing the size of your swap memory in windows? Otherwise known as "virtual memory". Depending on the speed of your drive and available space, you might be able to increase the vertual memory size to get more performance.

    But what about using a page archiving service, even a self-hosted one, like Shiori. Shiori has an extension that can allow for single click page archiving right from the browser. The pages are saved as html files or txt files and it will create a readability version of the file which is just the text and images. You could then search the files and their contents using something like VS Code to search the whole directory where the files are stored. There are plenty of other ways to do that search once you have those archives, though. I think even Windows File Search will search the contents of a txt or html file stored on the device.

    Shiori also has its own search, which is pretty fast, and searches the contents of the archives as well.

  • Undaunted@discuss.tchncs.de
    ·
    17 days ago

    I have no direct solution to you exact problem but your usage of tabs sounds like a nightmare.

    A while back I found Omnivore which works like a charm if you want to "freeze" the contents of a website to read them later. You can also self host it if you like.

    I took it a step further because I love Obsidian as personal knowledge management and I want to have everything in one place. There's a plugin to sync all your saved pages from Omnivore to Obsidian. In the template for it I then have my marked highlights, the links to the version in Omnivore and the original URL and also the whole content. So I have all of that in markdown which is really nice to work with.

    Maybe that's a solution you too could be happy with.

    • interdimensionalmeme@lemmy.ml
      hexagon
      ·
      17 days ago

      Thanks, never heard of Omnivore

      "Distraction free. Privacy focused. Open source"

      They do hit the right notes. I was going to try QOwnNotes but I'll put that on my list.

  • GenderNeutralBro@lemmy.sdf.org
    ·
    edit-2
    17 days ago

    I came in here knowing exactly what the comments would look like, and I'm still disappointed. "Just don't use so many tabs" is not an answer. If you don't have anything constructive to say, just move on instead of getting uppity about...not using browsers very heavily or understanding other use cases.

    Yeah, thousands of tabs seems extreme. But "you should dedicate a larger amount of time and effort all day, every day to make the computer's job easier" is a bad take. That's obviously worse than OP's existing workflow.

    Sorry OP, I don't have a real answer either. You might find Arc Browser's tab system to suit you better, but since it's chromium-based I suspect performance might be worse.

    Edit: out of curiosity, how much memory does your PC have, and how much is Firefox using during these freezes? I wonder how much of the delay is caused by swapping.

    • dependencyinjection@discuss.tchncs.de
      ·
      17 days ago

      Frankly the answer is to not use so many tabs.

      I think it’s crazy to need more than 10 active tabs open, let along thousands. I’m a software developer who will regularly go down rabbit holes and I’d never dream of opening so many tabs.

      The fact is OP isn’t using the browser in a way that it was designed for. Plus they’re being unreceptive and rude in some of their replies.

    • pop@lemmy.ml
      ·
      17 days ago

      Yeah, thousands of tabs seems extreme. But "you should dedicate a larger amount of time and effort all day, every day to make the computer's job easier" is a bad take.

      Computers don't magically make things easier, it just does as it is told(as instructed by code). Computers don't come out as a self-made human assistant that adapts to your personal needs and can magically do anything you want.

      If it's so much of a burden that smarter people haven't figured it out, go at it. You might just fix it.

      But "to make computer's job easier" is the dumbest shit I've heard in a while.

    • interdimensionalmeme@lemmy.ml
      hexagon
      ·
      17 days ago

      I am going to keep beating that drum until firefox gets better It's already improving, I used to struggle at 700 tabs now I almost make it to 2000. Of course it is mostly artifice as most tabs get fully discarded and what I want is all tab texts in live memory and the ability to search all tab text. Maybe even text search in all pictures in all tabs using object recognition, but clearly we're not anywhere near that yet !

  • Skunk@jlai.lu
    ·
    edit-2
    16 days ago

    I am not sure what you’re working on but from your answers I’ve read you seems to need access to a lot of information with a few keystrokes, like searching for a keyword or tag.

    In my opinion you are using the wrong tool for that. Ditch the browser and learn about the Zettelkasten way of working. It is really powerful for plenty of applications like science, studies, dev, or even the way I use it, author repository of ideas/concepts/stuff I need when writing a book.

    You can do that with several software but I like obsidian for that (and because of all its plugins you could probably find something to automatically copy webpage content)

    On the downside side :

    • You’ll have to learn Zettelkasten, Obsidian etc
    • Obviously do the work of writing (or copy pasting) your vault.

    But on the plus size :

    • You’ll have all the information you need at your fingertips, searchable with keywords, tags, associations etc.
    • Everything is basic text MD files so it will still be readable by any text editor or terminal in the next century.
    • You can have images, run code, do some mathlib, jupyter etc inside.
    • Text is light, easy to store, backup and retrieve.
    • If you do good enough you can have a satisfying visual representation of your new brain, kinda mindmap (which is also possible)

    Show

    • interdimensionalmeme@lemmy.ml
      hexagon
      ·
      16 days ago

      Cool I would love to navigate my data in a manner similar to this. However not obsidian, I am in the process of de-googling and I have severe cloud fatigue. But maybe QOwnNotes

      I'm hoping something like Archivebox or squid or some other software can help me, autodump everything in a way that will become accessible to these second party data management software. Hopefully in a manner as transparent as opening a tab.

      • Skunk@jlai.lu
        ·
        16 days ago

        Can you please tell me about that obsidian, google and cloud relationship ? Cause I don’t know anything about that and I’m curious.

        I don’t use any cloud except my own, self hosting FTW!

  • sgtlion [any]
    ·
    16 days ago

    I tend to have ~10,000 tabs because I obsessively fail to clean up. But it never takes much memory or cpu, my PC isn't amazing yet Firefox is always lightning quick.

    I've never used the discard or merge windows features though, I can see why those might cause issues. I assume these two functions just aren't optimised for so many tabs.

    One addon I might recommend to help keep numbers down is Duplicate Tab Closer, which has options to specify how similar tabs can be to be considered duplicates, and also will detect across all open windows if desired.

  • oscardejarjayes [comrade/them]
    ·
    17 days ago

    Oh, hmm, interesting. I would simply not bother trying to clean up your tabs (it's what I do, 6476 baby!).

    Perhaps consider also getting more RAM. 128 is good, 256 is better. Thanks to ddr5, ddr4 isn't all that expensive now (and 5000 series can't use ddr5 anyways).

    • interdimensionalmeme@lemmy.ml
      hexagon
      ·
      17 days ago

      I got some old HP G8 DL380 servers with 384GB ram in each, I am investigating running firefox in a VM on them and then somehow making only the firefox window appear on my PC. That would be awesome. I would have practically unlimited ram !

  • Rimu@piefed.social
    ·
    17 days ago

    I'm really curious about the workflow you have that needs that many tabs. How does the History and Bookmark functions fall short of what you need?

    • interdimensionalmeme@lemmy.ml
      hexagon
      ·
      17 days ago

      It's easier to use google than the bookmarks manager, which can't even find text inside the pages. I do often dump all those thousands of tabs into a bookmarks folder. And it has never happened that I went back into that enormous pile to fetch something that would take hours to find again. I have no use for the history either. A gigantic, alphabetic ordered list of everything I have seen in the last 7 days. Again, easier to just use google.

      The one thing that is better and faster than google, is not closing those tabs that may contain the stuff I need.

      Of course, it's not really possible to search the text body of open tabs, unless you search them one by one.

      But I'm going to ask for only one computing miracle at a time !

      • optissima@possumpat.io
        ·
        17 days ago

        What I'd recommend, based on the insistence that seeing to not change your workflow, is to locally download the pages you have open with httrack, wget or a similar application. This would allow you to locally search all your tabs and their contents very quickly without Google, they will load faster because of lack of needing to redownload them, which if I understand correctly Firefox is trying to do at some level.

        • interdimensionalmeme@lemmy.ml
          hexagon
          ·
          17 days ago

          Thanks, I didn't know that one.

          I have been experiementing with a transparent proxy like squid or something like Archive Box, to create static pages on the fly and load that.

          But so far I've not made something seamless and pleasant to use. It would have to be at least as low friction as using google.

          I am going to try using Mixtral 8x7b to perform natural language search over my archives and pull tabs from the collection of all pages I have ever seen. But that's still a long way away from being operational !

          • optissima@possumpat.io
            ·
            17 days ago

            ....has Google still been giving you the same results recently? This is an extremely weak link in your setup to me. You'd be better off looking at a locally run search engine like peARs or something similar with locally downloaded and indexed files if you insist on using search, and it'll be waaaay more reliable than an LLM here.

            • interdimensionalmeme@lemmy.ml
              hexagon
              ·
              17 days ago

              Google is giving me increasingly poor results, I am looking into deploying Searxng locally.

              I really would like to operate my own local crawler and sorting algorithm.

              I will check out the peARs you mentionned !