Skip to content

OPENSOURCE.md

Latest commit

 

History

History
70 lines (47 loc) · 1.9 KB

OPENSOURCE.md

File metadata and controls

70 lines (47 loc) · 1.9 KB
Raw

AllScrape Backend - Open Source

AllScrape Backend is an open-source web scraping and LLM-ready content extraction API built with FastAPI.

License

This project is licensed under the GNU General Public License v3 (GPLv3).

What This Means

  • ✅ You can use, modify, and distribute this software freely
  • ✅ You must provide source code access to your modifications
  • ✅ Derivative works must use the same GPLv3 license
  • ✅ You must include the original license and copyright notice
  • ✅ No warranty is provided

For full license details, see LICENSE and GPLv3 Legal Text

Contributing

We welcome contributions! Please read CONTRIBUTING.md for details on our code of conduct and the process for submitting pull requests.

All contributions are licensed under GPLv3.

Security

Please report security vulnerabilities responsibly. See SECURITY.md for details.

Code of Conduct

This project adheres to a Code of Conduct. By participating, you are expected to uphold this code.

Features

  • 🔍 Single URL scraping with multiple output formats
  • 🌐 Web search with automatic result scraping
  • 🤖 LLM-ready output format
  • 📊 Metadata extraction
  • ⚡ Fast async processing
  • 🧹 Clean text extraction

Quick Start

cd backend
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate
pip install -r requirements.txt
python -m playwright install chromium
python -m uvicorn app.main:app --reload

Documentation

Support

For issues, questions, or suggestions, please open a GitHub issue.

Acknowledgments

Built with:

  • FastAPI
  • BeautifulSoup4
  • Trafilatura
  • Playwright
  • curl_cffi
  • cloudscraper