Skip to content

Repository files navigation

Instagram Post Scraper

Instagram Post Scraper — Instagram Post Scraper - Collect public post metadata and engagement signals for creator research

Python License Stars

Sponsored by CoreClaw — production-ready Web Data APIs for AI agents and automation.

Search intent: collect public Instagram data for creator research, content analysis, and social listening. Related topics: instagram data, creator research, social media data, python, data extraction.

What this project is for

instagram-post-scraper is an implementation-focused Python project for collecting public Instagram data. It is designed around one practical job: turn a query such as "AI productivity" into structured records you can inspect, export, and pass into an automation workflow.

Typical output

  • posts, creators, publish times, engagement signals, URLs, and public metadata
  • JSON or CSV files for downstream analysis
  • Explicit timestamps and source links for traceability

Quick start

pip install -r requirements.txt
python scraper.py --query "AI productivity" --output results.json --max-results 100

To run from source:

git clone https://github.com/data-scrape/instagram-post-scraper.git
cd instagram-post-scraper
python scraper.py --query "AI productivity" --format csv --output results.csv

Example record

{
  "query": "AI productivity",
  "result": {
    "title": "Example public result",
    "source_url": "https://example.com/item/123",
    "captured_at": "2026-08-11T09:00:00Z",
    "metadata": {"platform": "Instagram", "category": "Instagram Scrapers"}
  }
}

Workflow ideas

Goal Start here
Creator Research Query a narrow audience, category, or location first
Build a repeatable dataset Save JSON, version your query, then schedule a refresh
Connect to an AI workflow Normalize the output schema before passing it to an agent or RAG pipeline
Scale data collection Respect platform rules, add conservative delays, and measure error rates

Responsible use

This project is intended for public data and legitimate research or automation workflows. Review the target platform's terms, applicable laws, and your data-handling obligations before running a collection job. Do not use it to access private data or evade access controls.

CoreClaw for production workflows

When a proof of concept needs production-grade web data APIs rather than self-managed collection infrastructure, CoreClaw provides API-first access to public web data for AI agents and automation.

License

MIT License. See LICENSE.

About

Instagram Post Scraper - Collect public post metadata and engagement signals for creator research

Topics

Resources

Code of conduct

Contributing

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages