Data Harvesting & How to Prevent it | Caspio
Share
  • Product
    • Product
      • Platform Overview
      • Features
      • Online Database
      • Discover No-Code
      • Marketplace
    • Services
      • Caspio One
      • Managed Application Services
      • Onboarding
    • Next Steps
      • Schedule a Demo
      • Free Trial
      • Project Consultation
      • Contact Sales
  • Solutions
    • Use Cases
      • Approval Workflow
      • Asset Management
      • COVID-19 Response
      • Custom CRM
      • Custom Web Form
      • Excel to Web App
      • Financial Reporting
      • Knowledge Base
      • MS Access Online
      • Online Survey
      • Patient Portal
      • Web Dashboard
    • Industries
      • Healthcare
      • Government
      • Energy
      • Finance
      • Consulting
      • Media
      • Nonprofits
      • Education
    • Customers
      • Featured Customers
      • Case Study Videos
      • Case Study Articles
      • Testimonials
  • Pricing
    • Pricing
      • Compare Plans
      • Project Consultation
      • Contact Sales
    • Discounts
      • Nonprofits and NGOs
      • Qualifying Countries
      • Academic Program
  • Resources
    • Discovery
      • Resource Center
      • Marketplace
      • Blog
    • Education
      • Free Online Training
      • Video Library
      • Onboarding
      • Get Certified
    • Support
      • Online Help
      • Community Forum
      • Contact Support
      • Request a Feature
  • Partners
    • Partner With Caspio
      • Find a Partner
      • Become a Partner
      • Referral Program
      • Academic Program
  • Company
    • About Caspio
      • About Us
      • News Center
      • Leadership
      • Careers
      • Contact Us
  • 1 (877) 820-9100
  • Contact Us
  • Blog
  • Login
  • Free Trial
Caspio logo
  • Login
  • Try Free
Try Free
  • Product
    • Product
      • Platform Overview
      • Features
      • Online Database
      • Discover No-Code
      • Marketplace
    • Services
      • Caspio One
      • Managed Application Services
      • Onboarding
    • Next Steps
      • Schedule a Demo
      • Free Trial
      • Project Consultation
      • Contact Sales

    featured

    Digital Success. One and Done.

    Digital Success. One and Done.TM

    Experience the best of everything
    Caspio has to offer.

    Learn More
  • Solutions
    • Use Cases
      • Approval Workflow
      • Asset Management
      • COVID-19 Response
      • Custom CRM
      • Custom Web Form
      • Excel to Web App
      • Financial Reporting
      • Knowledge Base
      • MS Access Online
      • Online Survey
      • Patient Portal
      • Web Dashboard
    • Industries
      • Healthcare
      • Government
      • Energy
      • Finance
      • Consulting
      • Media
      • Nonprofits
      • Education
    • Customers
      • Featured Customers
      • Case Study Videos
      • Case Study Articles
      • Testimonials
  • Pricing
    • Pricing
      • Compare Plans
      • Project Consultation
      • Contact Sales
    • Discounts
      • Nonprofits and NGOs
      • Qualifying Countries
      • Academic Program

    featured

    Start Your Free Trial in 30 Seconds

    Start Your Free Trial in 30 Seconds

    Try Free
  • Resources
    • Discovery
      • Resource Center
      • Marketplace
      • Blog
    • Education
      • Free Online Training
      • Video Library
      • Onboarding
      • Get Certified
    • Support
      • Online Help
      • Community Forum
      • Contact Support
      • Request a Feature

    featured

    Learn to Build Caspio Apps for FREE

    Learn to Build Caspio Apps for FREE

    Sign Up
  • Partners
    • Partner With Caspio
      • Find a Partner
      • Become a Partner
      • Referral Program
      • Academic Program

    featured

    Stretch the Limits of Low-Code: Mobile Apps, Messaging, Integrations & More

    Stretch the Limits of Low-Code: Mobile Apps, Messaging, Integrations & More

    Watch Webinar
  • Company
    • About Caspio
      • About Us
      • News Center
      • Leadership
      • Careers
      • Contact Us

    featured

    Ukraine Flag

    Stand With Ukraine

    Learn More
  • 1 (877) 820-9100
  • Contact Us

What You Need to Know about Data Harvesting and How to Prevent it

August 27, 2014

  • Tech Tips
  • Customer Spotlight
  • News Articles
Try Free
  • Home
  • Blog
  • Current Article
8543
August 27, 2014
What You Need to Know about Data Harvesting and How to Prevent it

The term data harvesting, or web scraping, has always been a concern for website operators and data publishers. Data harvesting is a process where a small script, also known as a malicious bot, is used to automatically extract large amount of data from websites and use it for other purposes. As a cheap and easy way to collect online data, the technique is often used without permission to steal website information such as text,  photos, email addresses, and contact lists.

One method of data harvesting targets databases in particular. The script finds a way to cycle through the records of a database and then download each and every record in the database.

Aside from obvious consequence of data loss, data harvesting can also be detrimental to businesses in other ways:

  • Poor SEO Ranking: If your website content is scraped, reproduced and used on other sites, this will significantly affect the SEO ranking and performance for your website on search engines.
  • Decreased Website Speed: When used repeatedly, scraping attacks can lower the performance of your websites and affect the user experience.
  • Lost Market Advantages: Your competitors may use data harvesting to scrape valuable information such as customer lists to gather intelligence about your business.

Various methods are available to help website builders protect different types of online data from being scrapped. For database protection, Caspio provides several tools to help prevent your data from being targeted by malicious bots.

  • CAPTCHA — One of the most effective methods to fight data harvesting is CAPTCHA (Completely Automated Public Turing Test to Tell Computers and Human Apart). It protects an ad hoc search against bots by displaying a code and tests that only humans can verify to ensure the user is not a bot. With Caspio, you can easily implement CAPTCHA on your search forms and prevent bots from collecting your data.
  • Access Control — Caspio Reports provide a built-in feature to create search criteria for authorizing access to database records. To be more specific, only records that match the search criteria can be accessed. Therefore, data harvesting can be prevented because a bot cannot gain access to records that do not match the search criteria through the report. The same is true with Record Level Security, where you can set a limit on what a user can access down to each record in a database, which prevents either a human user or a bot from gaining access to any unauthorized records.
  • Complex IDs — Many databases use an auto-number or other sequential ID forms as database keys. If you have an Update Form or a pre-defined criteria Report based on a sequential ID, it’s very easy for a bot to cycle through all your records using the sequential IDs. Using a much more complex ID such as a GUID is one way to address this. In Caspio, you can easily generate random unique IDs in a hidden text field in a Submission Form as new records are created. Another method is to require two fields to bring up a record, such as an ID field combined with some other value. This way, the bot will have to correctly guess both fields in order to retrieve the record, making it more difficult to program.

Last but not least, password-protecting your database isn’t designed specifically to prevent data harvesting, but it does limit access to only authorized and trusted users and is another measure to protect your data from unauthorized access.

If you’re interested in knowing more about how to implement security safeguards such as CAPTCHA using the Caspio platform, simply sign up for a free trial and try it for yourself. You can also request a project consultation to go over specific features.

Caspio Free Trial Caspio Free Trial
Previous Post:
3 Ways to Use GUIDs in Your Database Applications
Next Post:
The Fastest Way to Publish Microsoft Access Online

Recommended Articles

How to Build a Simple Project Management App to Boost Remote Work Productivity

How to Build a Simple Project Management App to Boost Remote Work Productivity

Custom CRM Tips: Improve Your Customer Relationships With These Best Practices

Custom CRM Tips: Improve Your Customer Relationships With These Best Practices

20 Online Business Dashboards You Can’t Live Without, And That You Can Build Right Now

20 Online Business Dashboards You Can’t Live Without, And That You Can Build Right Now

5 Apps You Can Deploy Right Now to Support Teleworking and Business Continuity

5 Apps You Can Deploy Right Now to Support Teleworking and Business Continuity

The Risks of Using Excel for Data Management, and How to Avoid Them

The Risks of Using Excel for Data Management, and How to Avoid Them

How COVID-19 Changed the Role of CIOs

How COVID-19 Changed the Role of CIOs

IT Helpdesk App: 5 Essential Features to Look For

IT Helpdesk App: 5 Essential Features to Look For

COVID-19 Response: 8 Low-Code Apps Your Government Agency Needs Right Now

COVID-19 Response: 8 Low-Code Apps Your Government Agency Needs Right Now

Midstream Oil & Gas Companies: Digitally Transforming For a Bright Future

Midstream Oil & Gas Companies: Digitally Transforming For a Bright Future

Subscribe for More Updates
Caspio Logo

Caspio is the world’s leading cloud platform for building online database applications without coding. Start a free trial today and experience the power of no-code.

  • PLATFORM

  • Platform Overview
  • Features
  • Marketplace
  • Compare Plans
  • Schedule a Demo
  • Try Free
  • SOLUTIONS

  • Healthcare
  • Government
  • Education
  • Consulting
  • Media
  • Nonprofits
  • USE CASES

  • Custom CRM
  • Knowledge Base
  • Web Dashboard
  • Custom Web Form
  • Excel to Web App
  • MS Access Online
  • RESOURCES

  • Resource Center
  • Case Studies
  • Featured Customers
  • Video Library
  • Testimonials
  • Blog
  • SUPPORT

  • Free Training
  • Onboarding
  • Online Help
  • Community Forum
  • Open a Ticket
  • Get Certified
  • COMPANY

  • Careers
  • News & Events
  • Leadership
  • Partner Programs
  • Referral Program
  • Contact Us
  • AICPA SOC Logo

© 2023 Caspio, Inc. Sunnyvale, California. All rights reserved.

  • Privacy Statement
  • Terms of Use
  • Report Abuse
  • Sitemap
  • Feedback