Found 3 result(s).
Integrate Multiple Scrapy Projects with PostgreSQL on Hetzner + Metabase Setup Description: We are running several existing Scrapy-based web scraping projects that collect job offer data (title, company, location, etc.). We now want to centralize and store all scraped data in a PostgreSQL database hosted on a dedicated Hetzner server, and make it accessible through Metabase for reporting and vis...
Delivery Time: 6 days left days
Project Overview: We are a SaaS company with a multi-tenant architecture and Kafka-based event pipelines. We are looking for a skilled data engineer to implement an ELT system using: - Kafka (event source) - Kafka Connect (for streaming data into a central warehouse) - PostgreSQL (as the reporting warehouse) - dbt (for transformation and normalization) - Metabase (for dashboards and non-developer-...
Job Type: Hourly
We are seeking an experienced Data Engineer to help us define and set up an ELT pipeline in AWS using the medallion architecture. This project involves creating efficient data ingestion processes, data transformation, and storage solutions to facilitate accurate reporting. The ideal candidate should have a strong background in data engineering and AWS services, ensuring a robust and scalable pipel...
Job Type: Hourly: $35.00 - $75.00
SQL AWS Glue dbt Amazon Web Services ETL Pipeline Python Amazon EC2 Amazon S3 Metabase Amazon Redshift