Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Need a VPS server recommendation for ScreamingFrog crawling, budget: $10.

Could someone suggest an ideal VPS server suitable for web crawling with ScreamingFrog? What specific characteristics should I consider in a VPS to achieve the best results for this purpose?

I need to crawl a website with approximately 1 million pages. I have a budget of up to $10 per month, and the primary audience for our website is in the United States.

Comments

  • yusrayusra Barred
    edited November 2023

    Screaming frog supports Linux too so you can get pretty decent linux VPS and increase the specs.

    Thanked by 1Adriana_Russell
  • I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

  • @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    i can provide yabs for wheelchairinglabrador

  • @gbzret4d said: i can provide yabs for wheelchairinglabrador

    Don't forget the PoliteFurryToothlessCrocodile.

    Thanked by 1gbzret4d
  • Or SlipperyHedgehog

  • @Adriana_Russell said:
    Could someone suggest an ideal VPS server suitable for web crawling with ScreamingFrog? What specific characteristics should I consider in a VPS to achieve the best results for this purpose?

    I need to crawl a website with approximately 1 million pages. I have a budget of up to $10 per month, and the primary audience for our website is in the United States.

    There is a use case conducted by the SF team. You can find detailed information about it on the Screaming Frog website at https://www.screamingfrog.co.uk/seo-spider-cloud/.

    Consider using hourly billing providers such as UpCloud, Vultr, and others. Run the necessary tasks as per your requirements, save the results, and analyze locally.

    Thanked by 1Adriana_Russell
  • @gbzret4d said:

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    i can provide yabs for wheelchairinglabrador

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    @jenkki said:

    @gbzret4d said: i can provide yabs for wheelchairinglabrador

    Don't forget the PoliteFurryToothlessCrocodile.

    @jenkki said:
    Or SlipperyHedgehog

    HOW DO YOU GUYS KEEP GUESSING ALL MY PASSWORDS?!

  • this board gets spammier every day, no mods working?

  • @xyl0n said: this board gets spammier every day

    You just need a little bit sense of humor.

  • emghemgh Veteran, Megathread Squad

    @jenkki said:

    @xyl0n said: this board gets spammier every day

    You just need a little bit sense of humor.

    Obviously not too much though

  • gbzret4dgbzret4d Member
    edited November 2023

    @wpsokw said:

    @gbzret4d said:

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    i can provide yabs for wheelchairinglabrador

    @jenkki said:
    I recommend using SpeedyTurtle or SightedBlueEyedMole crawling.

    @jenkki said:

    @gbzret4d said: i can provide yabs for wheelchairinglabrador

    Don't forget the PoliteFurryToothlessCrocodile.

    @jenkki said:
    Or SlipperyHedgehog

    HOW DO YOU GUYS KEEP GUESSING ALL MY PASSWORDS?!

    @xyl0n said:
    this board gets spammier every day, no mods working?

    OldGrumpyBoomerCoati

  • @Dazzle said:

    @Adriana_Russell said:
    Could someone suggest an ideal VPS server suitable for web crawling with ScreamingFrog? What specific characteristics should I consider in a VPS to achieve the best results for this purpose?

    I need to crawl a website with approximately 1 million pages. I have a budget of up to $10 per month, and the primary audience for our website is in the United States.

    There is a use case conducted by the SF team. You can find detailed information about it on the Screaming Frog website at https://www.screamingfrog.co.uk/seo-spider-cloud/.

    Consider using hourly billing providers such as UpCloud, Vultr, and others. Run the necessary tasks as per your requirements, save the results, and analyze locally.

    Thanks Dear Dazzle.
    I checked the link of the page you sent me.
    I will also check the sites you sent for the best decision.
    Thank you for helping me.

Sign In or Register to comment.