Sr. Data Engineer


$45.00

We're seeking a Senior Data Engineer to design and implement robust data infrastructure that powers AI systems. You'll build scalable data pipelines and storage solutions while ensuring data security and compliance. You'll collaborate with data scientists and analysts to enable efficient data access and processing. Responsibilities: Design, develop, and maintain scalable etl/elt pipelines for processing large datasets build and optimize data storage solutions (data warehouses, data lakes, etc.) Work with relational and NoSQL databases to ensure data integrity and performance Automate workflows using Apache Airflow, Prefect, or similar tools Ensure data security, governance, and compliance (gdpr, hipaa, etc.) Collaborate with data scientists and analysts to enable efficient data access Work with cloud platforms (AWS, Azure, GCP) for scalable data solutions Requirements: 5+ years of experience in data engineering, big data processing, or software development Strong programming skills in Python, SQL, or Scala Experience with ETL tools (dbt, Apache NiFi, Talend, etc.) Knowledge of database systems (PostgreSQL, MySQL, Snowflake, Redshift, BigQuery, etc.) Experience with cloud services (AWS S3, Lambda, Glue, Azure Data Factory, GCP BigQuery) Familiarity with data modeling and schema design Understanding of distributed computing frameworks (Hadoop, Spark, etc.) Apply Now!!Category: IT & ProgrammingSubcategory: Data ScienceIs this a project or a position?: ProjectRequired availability: Full time

Keyword: SQL

Price: $45.0

Amazon Web Services (AWS) Data Warehousing Microsoft Azure Python SQL Google Cloud Platform (GCP) Apache Hadoop Data Science Extract Transform Load (ETL)

 

C+ .NET Project

I am looking for someone to help with tasks and to optimize an existing web app that is hosted on Azure. This will be completing some tasks for the app needs updating as well as optimizing an API integration.

View Job
Formación Sage 200c: Informes, Consultas y Personalización

Adquirir los conocimientos técnicos necesarios para diseñar, personalizar y gestionar informes y consultas en Sage 200c, así como acceder y manipular su base de datos para reporting avanzado o integraciones con otros sistemas.

View Job
Payment API's

looking to understand how payment API's work- Looking for someone explain to me how a payment API is built and how it works. I understand it at a high level but looking to be able to understand it in more detail. This is more of a teaching scenario than a business proje...

View Job