We are looking for a Senior Backend Engineer to join a short-term web project (2 months) focused on building and optimizing data ingestion pipelines and data flow management in a cloud-based analytics environment.
You will work closely with our data and web teams to design, implement, and optimize scalable data ingestion solutions feeding into a BigQuery (or Redshift) warehouse.
Responsibilities
- Design, implement, and maintain data ingestion pipelines for structured and semi-structured data.
- Integrate data from multiple web and application sources into BigQuery (preferred) or Amazon Redshift (with Streams).
- Optimize data flow, transformation, and storage for performance and scalability.
- Monitor and troubleshoot ingestion performance and reliability issues.
- Ensure data quality, consistency, and compliance with project requirements.
- Write clean, efficient, and maintainable backend code following best practices.
Knowledge and skills
- 5+ years of experience as a Backend Engineer / Data Engineer.
- Proven experience with data ingestion systems (streaming or batch).
- Strong expertise in BigQuery or Amazon Redshift (including Streams).
- Proficiency in at least one backend programming language such as Python, Node.js, or Go.
- Strong understanding of SQL and ETL/ELT concepts.
- Experience with RESTful APIs and web application integration.
- Solid understanding of cloud-based architectures (GCP or AWS).
- Experience with CI/CD pipelines and version control (Git).
- Excellent problem-solving and communication skills.
- Proficiency in English (min. B2).
Nice to have
- Experience with real-time data streaming (Kafka, Pub/Sub, Kinesis).
- Knowledge of data modeling and schema design for analytics systems.
- Familiarity with data validation and monitoring frameworks.
- Experience working in Agile environments with distributed teams.
Deliverables / Expected outcomes
By the end of the 2-month engagement, you are expected to:
- Design and deliver a robust data ingestion layer into BigQuery/Redshift.
- Document data flow architecture and operational processes.
- Provide recommendations for scalability and monitoring.
- Ensure successful integration with the web project’s data pipeline.
Why Join?
- Short, high-impact project with modern data technologies.
- Collaborative and experienced international team.
- Opportunity to architect and deliver an end-to-end ingestion system from scratch.