Senior Data Platform Engineer
We are invent.ai
invent.ai is a fast-growing company providing AI-Decisioning for Inventory, Merchandising and Pricing Optimization Solutions to retailers around the world. This is an exciting time at invent.ai, as we are growing our client base, our product portfolio, and our teams to revolutionize the supply chain planning industry.
We are a group of bright, kind, and goal-oriented people working together to make retail better. We take pride in what we do. As a provider of award-winning enterprise-AI SaaS solutions that serve a growing international business with customers across the U.S., Europe, the Middle East, and East Asia, we make a measurable and meaningful difference for our customers every day.
Headquartered in the United States and with offices around the world, our team of 350+ people consists of young engineers and data scientists from top CS and engineering programs, collaborating across our Istanbul, Ankara, Philadelphia, and Amsterdam offices.
For more information, visit www.invent.ai
About Role
We're seeking a Senior Data Platform Engineer to design, build, and evolve our end-to-end data ecosystem. Serving as the vital bridge between raw infrastructure and practical data engineering, your mission is to provide a seamless, scalable platform for our data teams. You will be responsible for ensuring the robustness of our underlying cloud infrastructure (Kubernetes on Azure/AWS), orchestrating complex pipelines via Airflow, and optimizing the PySpark/Python execution environments that power our data products.
Responsibilities:
- Develop “best-in-class” architecture, design and production artifacts by ensuring that the services and the components are: well-defined and modularized, secure, scalable, reliable, reusable, diagnosable, and actively monitored.
- Contribute to all phases of new developments including architecting, prototyping, productizing, testing and support.
- Adhere to and drive modern software engineering practices through code and design reviews, exercise DevOps principles to deploy, maintain and monitor production workflows and services to provide continuous delivery with high quality and actionable telemetry data.
- Stay educated on existing and state of the art technologies, and do proof of concept studies to evaluate technology fits relevant to our product requirements.
- Understanding business objectives and developing models that help to achieve them, along with metrics to track their progress.
- Mentor junior developers with coaching and participating code/design reviews
AI Proficiency
End-to-End AI Leverage
- Proficient in integrating AI coding assistants, CLIs, and Model Context Protocols (MCPs) within a connected development environment.
- Effectively uses AI to accelerate the entire software development lifecycle—spanning from planning, architectural design, implementation, troubleshooting, bug-fixing, cross-team communication, deployment, and observability.
- Orchestrates multiple AI tools and models to cross-reference solutions, deepen technical understanding, and apply sound engineering judgment on AI recommended plans and AI driven execution.
- Builds reusable AI tooling ( CLAUDE.md files, agent rules, skills, slash commands, internal MCPs ) that compounds productivity over time, and applies judgment about when not to reach for AI
AI Guardrails and System Health
- Balances AI-driven speed with rigorous engineering standards. Implements robust automated testing and structural guardrails and CI mechanisms to validate AI-generated code and preventing technical debt.
- Builds robust operational infrastructure to support rapid development, emphasizing safe rollout strategies and reliable rollback mechanisms. Maintains deep system observability to continuously monitor production health and validate the real-world impact of AI-assisted contributions.
What We Are Looking For
Qualifications:
- Bachelor’s degree or higher in a related field
- 4-6+ years working with distributed production systems at scale
- Data Engineering & Orchestration: Hands-on experience designing data platforms, including managing workflow orchestration (e.g., Apache Airflow, Dagster etc.) and utilizing Python/PySpark for data processing.
- Data Architecture & Governance: Understanding of modern data lakehouse architectures (Delta Lake, Snowflake, Iceberg etc.), metadata management concepts, and experience integrating data catalogs (OpenMetadata, DataHub, etc.). Experience in observing & tracing data quality, data lineage etc.
- Data Access & Storage Proficiency: Hands-on experience manipulating data across varied storage systems, including traditional relational databases and NoSQL document/key-value stores.
- Software Engineering Foundation: Strong grasp of Python software design, including Object-Oriented Programming (OOP) patterns and effective use of data structures for building robust, maintainable automation and tooling.
- API & Microservices Development: Proficiency in designing and building internal REST APIs using modern Python frameworks (FastAPI, Flask, AWS Serverless etc.) to expose platform functionality or create self-service tools.
- Cloud Computing & Infrastructure: Hands-on experience building and maintaining scalable solutions within cloud environments. Proficiency in navigating modern cloud ecosystems and platforms (such as Azure, AWS, GCP, Databricks etc.) with the ability to adapt to multi-cloud architectures. Detailed familiarity with essential cloud service offerings (Compute, Storage, Networking, IAM) is highly desirable.
- Container Orchestration & Continuous Delivery: Expertise in the complete container lifecycle, from packaging applications with Docker to managing production-grade orchestration via Kubernetes. Proven ability to design and implement robust CI/CD pipelines using a mix of established tools like Jenkins, GitHub Actions etc. and modern GitOps workflows (e.g., Flux, ArgoCD) for reliable, reproducible infrastructure and application deployments.
Life at invent.ai
- Join great teammates across the globe: We consider ourselves anything but average!
- We love what we do: Our team has an exciting tech stack; Pyspark, Databricks, Python, and so on
- Flat organization with a very strong entrepreneurial culture,
- We support your career growth with Udemy, Medium, HBR and other learning tools
- At invent.ai, you have extra off days for different occasions (birthday, moving day, maternity & paternity leaves etc.)
- Work hard, play harder, unlimited fun at work: All-day snacks at the office, team activities, social club meetings, annual retreats, monthly happy Friday drinks and other celebrations. Also, we love gaming and so have a Game Master at Invent! (We really mean it when we say we love it!)
- We believe that we will be more productive when we achieve our work-life balance. We support the Invent social clubs for their hobbies; painting, tennis, football and more!
Diversity, Equity and Inclusion
invent.ai provides equal employment opportunities, and we strive for a diverse and inclusive workplace. We are together without discrimination of nationality, gender, belief, age, disability, marital status, sexual orientation. For us, diversity means embracing all the features that make us unique.
Corporate Social Responsibility
We care about social responsibility, invent.ai gives you the opportunity to make a real difference in people's lives.
- Support initiatives such as educational scholarships, donations, young talent sponsorships, and fundraising activities for non-governmental organizations.
- Have an Earthquake Fund, where invent.ai matches employee donations 1:1 to support underprivileged students.
Invent the Future with Us
Does this sound like your next dream job? Let's get you started!
We look forward to meeting you!
Please click on the link for the privacy notice for prospective employees.
