Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Need a VPS server recommendation for ScreamingFrog crawling, budget: $10.
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Need a VPS server recommendation for ScreamingFrog crawling, budget: $10.

Could someone suggest an ideal VPS server suitable for web crawling with ScreamingFrog? What specific characteristics should I consider in a VPS to achieve the best results for this purpose?

I need to crawl a website with approximately 1 million pages. I have a budget of up to $10 per month, and the primary audience for our website is in the United States.

Comments

  • yusrayusra Member
    edited November 2023

    Screaming frog supports Linux too so you can get pretty decent linux VPS and increase the specs.

    Thanked by 1Adriana_Russell
  • I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

  • @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    i can provide yabs for wheelchairinglabrador

  • @gbzret4d said: i can provide yabs for wheelchairinglabrador

    Don't forget the PoliteFurryToothlessCrocodile.

    Thanked by 1gbzret4d
  • Or SlipperyHedgehog

  • @Adriana_Russell said:
    Could someone suggest an ideal VPS server suitable for web crawling with ScreamingFrog? What specific characteristics should I consider in a VPS to achieve the best results for this purpose?

    I need to crawl a website with approximately 1 million pages. I have a budget of up to $10 per month, and the primary audience for our website is in the United States.

    There is a use case conducted by the SF team. You can find detailed information about it on the Screaming Frog website at https://www.screamingfrog.co.uk/seo-spider-cloud/.

    Consider using hourly billing providers such as UpCloud, Vultr, and others. Run the necessary tasks as per your requirements, save the results, and analyze locally.

    Thanked by 1Adriana_Russell
  • @gbzret4d said:

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    i can provide yabs for wheelchairinglabrador

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    @jenkki said:

    @gbzret4d said: i can provide yabs for wheelchairinglabrador

    Don't forget the PoliteFurryToothlessCrocodile.

    @jenkki said:
    Or SlipperyHedgehog

    HOW DO YOU GUYS KEEP GUESSING ALL MY PASSWORDS?!

  • this board gets spammier every day, no mods working?

  • @xyl0n said: this board gets spammier every day

    You just need a little bit sense of humor.

  • @jenkki said:

    @xyl0n said: this board gets spammier every day

    You just need a little bit sense of humor.

    Obviously not too much though

  • gbzret4dgbzret4d Member
    edited November 2023

    @wpsokw said:

    @gbzret4d said:

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    i can provide yabs for wheelchairinglabrador

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    @jenkki said:

    @gbzret4d said: i can provide yabs for wheelchairinglabrador

    Don't forget the PoliteFurryToothlessCrocodile.

    @jenkki said:
    Or SlipperyHedgehog

    HOW DO YOU GUYS KEEP GUESSING ALL MY PASSWORDS?!

    @xyl0n said:
    this board gets spammier every day, no mods working?

    OldGrumpyBoomerCoati

  • @Dazzle said:

    @Adriana_Russell said:
    Could someone suggest an ideal VPS server suitable for web crawling with ScreamingFrog? What specific characteristics should I consider in a VPS to achieve the best results for this purpose?

    I need to crawl a website with approximately 1 million pages. I have a budget of up to $10 per month, and the primary audience for our website is in the United States.

    There is a use case conducted by the SF team. You can find detailed information about it on the Screaming Frog website at https://www.screamingfrog.co.uk/seo-spider-cloud/.

    Consider using hourly billing providers such as UpCloud, Vultr, and others. Run the necessary tasks as per your requirements, save the results, and analyze locally.

    Thanks Dear Dazzle.
    I checked the link of the page you sent me.
    I will also check the sites you sent for the best decision.
    Thank you for helping me.

Sign In or Register to comment.