I found the api a lot better than any python scraping api till date. However I am tempted to try out python with Crawlee.
The playwright integration with gotScraping makes the entire programming experience a breeze. My crawling and scraping involves all kinds of frontend rendered websites with a lot of modified XHR responses to be captured. And IT JUST WORKS!
Thanks a ton . I will definitely use the Apify platform to scale given the integration.
And after having similar and more issues with Airbnb, i look for a hotel room.
Most of them outsource their tech to the tech-outsourcing behemoths who are also run by man-month billing _innovations_
I see no hope of things improving drastically. Small incremental updates over decades till we invent teleportation... then they will die.
Thanks for sharing your story of perseverance and spirit.
Now that you are at it, are there any easy-to-use solutions to solve time-tabling problems for school/colleges. I know of solutions which use GA, but since its a generic problem for every academic institution, someone(you) might want to provide an easy to configure and use solution.
I switched to Linux(redhat and then ubuntu) for the next 8 years and loved vim and programming tools that linux had to offer. The resource utilization was never a blocker. The frustrating part was wireless drivers and machine hanging up because of them.
I recently shifted to OSX and installed iTerm/vim and all that. There have been no issues with wireless hardware and resource utilization. However, setting up production-like environment, which runs on Linux is a huge pain. Running a dual-boot ubuntu is also not as seamless and there are quite a few display driver issues. My take:
- If you have just started programming, start with Linux (if you haven't fought enough to compile drivers for your machine, you are one bit less of a real programmer)
- If you are doing a lot on the server side which largely is Linux driven, then you better use Linux to understand systems and deployment.
- If you are using eclipse, then you better shift to OSX because no other hardware-os combo at that price can let you code in peace.