Senior Data Engineer (Go)

We are a leading European AI company developing large language models and generative platforms for enterprise and government clients.Our products combine high-performance technologies, data security, and transparency, fully aligned with European regulatory and ethical standards.As a Data Engineer, you will design, build, and maintain high-performance backend services and data pipelines, enabling our teams to deliver scalable, reliable, and production-ready systems.Responsibilities:ETL Data Pipelines (Batch & Streaming)Develop and operate ETL pipelines to extract, transform, and load data from multiple sourcesSupport both batch workloads (large-scale periodic data processing) and streaming workloads (real-time or near-real-time data flows)Optimize performance, scalability, and reliability of data processing pipelinesCollaborate with data engineers and analysts to ensure high-quality, clean, and accessible datasetsML Data Pipelines using TemporalDesign, implement, and maintain robust ML data pipelines for training, validation, and inference of machine learning modelsUse Temporal for workflow orchestration, ensuring reliability, retries, and state management across complex ML workflowsCollaborate closely with ML engineers and researchers to automate and scale model pipelinesEnsure pipelines are reproducible, maintainable, and observableBackend Services & InfrastructureDesign, build, and maintain backend services in Go Work with PostgreSQL and object storage (S3) to store and manage structured and unstructured dataDeploy and manage services using Kubernetes (K8s) and HelmImplement best practices in CI/CD using GitHub ActionsApply system design and data modeling principles, handling concurrency and performance optimizationRequirements:3+ years of commercial experience in Go (most of which in a production setup with real customers)Strong knowledge of ETL pipeline development (batch and streaming workloads)Experience with Temporal or other asynchronous workflow orchestration toolsExperience with PostgreSQL and object storage (S3)Familiarity with Kubernetes (K8s) and HelmUnderstanding of concurrency patterns and performance optimization in GoExperience building and operating ML data pipelines is highly desirableStrong collaboration skills and attention to detailNice to Have:Experience designing APIs/SDKsExperience with complex migrations or data model changesKnowledge of TDD, DDD, or other development best practicesFamiliarity with resiliency patterns (retries, circuit breakers)Experience integrating backend systems with ML modelsExperience with OpenFGA or similar toolsFamiliarity with stakeholder management and brief, concise communicationTechnology Stack:Core Backend: Python (FastAPI), GoData Storage: PostgreSQL, S3 / object storageWorkflow Orchestration: Temporal (for ML pipelines)ETL: Batch and streaming pipelinesDevOps & Infrastructure: Kubernetes (K8s), Helm, GitHub ActionsInternal Tools: TypeScript / Nx for CLI automation (if applicable)