IJF Data Pipeline

This is the IJF’s backend data pipeline. It is responsible for collecting data, matching it to the IJF’s schemas and storing it in our production postgres database.

These documents are hosted online here. Please keep the URL private.

Getting started

• Overview
• Quickstart
• How the pipeline runs

Contributing

• Crawl

Deployment

• Deployment on AWS
• Creating a Copilot App