SiteChecker is an intelligent automation system that continuously monitors website health by combining web scraping, AI-powered issue analysis, and automated workflow triggers. It runs on scheduled 2-hour cycles, detects anomalies autonomously using LangChain, and automatically creates GitHub issues when problems are found β eliminating the need for manual monitoring.
- Automated web scraping on 2-hour scheduled cycles
- AI-powered issue detection using LangChain
- FastAPI backend for data ingestion and processing
- SQLite database for persistent storage
- Streamlit dashboard for real-time visualisation
- GitHub API integration for automated issue creation
1. Clone the repo
git clone https://github.com/MuteebHashmi/SiteChecker.git
cd SiteChecker2. Install dependencies
pip install -r requirements.txt3. Set up environment variables
Create a .env file in the root directory:
OPENAI_API_KEY=your_openai_key
GITHUB_TOKEN=your_github_token
GITHUB_REPO=your_username/your_repo
4. Run the FastAPI backend
uvicorn main:app --reload5. Run the Streamlit dashboard
streamlit run dashboard.pySiteChecker/
βββ main.py # FastAPI backend
βββ scraper.py # Web scraping logic
βββ analyzer.py # LangChain AI analysis
βββ dashboard.py # Streamlit dashboard
βββ database.py # SQLite database handler
βββ requirements.txt
βββ .env.example