Требуемый опыт работы: 3–6 лет
Полная занятость, удаленная работа
Job description
We are looking for a for a Data Engineer (DevOps), who will define our data platform that includes platform API, Web Services, Data Processing Pipelines, Data Security and Data Warehousing (DWH). You will work agile cross-functionally deploying APIs, new data transformations, managing databases, and supporting production operations at our prominently located offices in Berlin or Frankfurt. As a Data Engineer you will need a deep understanding of the product areas, both at the technical and feature level, along with playing a role in all phases of software development: planning, designing, implementation, testing, deployment, and day-to-day operation.
Your Tasks & Responsibilities
Английский — B1 — Средний
Python
PostgreSQL
Git
Machine Learning
Английский язык
Linux
Software Development
Azure
Полная занятость, удаленная работа
Job description
We are looking for a for a Data Engineer (DevOps), who will define our data platform that includes platform API, Web Services, Data Processing Pipelines, Data Security and Data Warehousing (DWH). You will work agile cross-functionally deploying APIs, new data transformations, managing databases, and supporting production operations at our prominently located offices in Berlin or Frankfurt. As a Data Engineer you will need a deep understanding of the product areas, both at the technical and feature level, along with playing a role in all phases of software development: planning, designing, implementation, testing, deployment, and day-to-day operation.
Your Tasks & Responsibilities
- Monitore the application post Go Live and ensure pro-activity the performance and stability of software
- Collaborate with engineering and product teams to ensure the right technology stack is selected, product features within Azure Infrastructure and provide feedback to the core product team
- Collaborate between end customer IT team for deployment as well as with core product and engineering teams to ensure continuous deployment of features
- Design the data pipelines and infrastructure to support enterprise machine learning systems at scale and identify and evaluate new technologies to improve performance, maintainability, and reliability of deep learning systems
- Develop and deploy scalable tools and services for our clients to handle machine learning inference
- Take offline models data scientists build and turn them into a real machine learning production system
- Apply software engineering best practices to machine learning, including CI/CD, automation, testing
- Support model development, with an emphasis on auditability, versioning, and data security
- Facilitate the development and deployment of proof-of-concept machine learning system
- Experience building end-to-end systems in a similar Data Engineer, Platform Engineer, ML DevOps Engineer, or DevOps Engineer role in Linux OS and cloud (Azure) environment (2+ years)
- Knowledge of Continuous Integration and Continuous Delivery (CI/CD) using Kubernetes
- The ability to design robust, coherent, and orchestrateable APIs using KubeFlow, Argo, Airflow
- Knowledge of "older" Client-Server architectures as well as more "modern" microservices and Progressive Web Apps
- Expertise in code deployment and maintenance of software in Azure Cloud environment
- Experience in managing databases like ElasticSearch, PostgreSQL, etc.
- Strong software engineering skills in complex, multi-language systems and in working with cloud computing and database systems and ability to define code/ design guidelines for quality, maintainability, and extensibility, etc.
- Fluency in Python, familiarity with Django, HTML, CSS, Typescript, Angular 9 are a plus
- Experience developing and maintaining ML machine learning systems and exposure to deep learning approaches and modeling frameworks like: PyTorch, Keras, Tensorflow, etc.
- Azure Cloud Certifications (AZ103, AZ203, AZ300) is desired
- Certification on DevOps, DevOps related Tools, Systems Administration, Networking, Cloud, Scrum, SAFe and published blogs, articles, contributions to OpenForums or Technical Forums is a plus
- You are a diligent planner, outstanding communicator and creator of inspiring team environment to set clear goals, delegate tasks and set deadlines
- You like challenges and are not intimidated by complex systems, processes, and dependencies
- You are able to take ownership and responsibility for tasks and projects
- Strong problem solving and troubleshooting skills and exposure to machine learning methodology and best practices
- You are fluent in English. Knowledge of German would be an added advantage
Ключевые навыки
Английский — B1 — Средний
Python
PostgreSQL
Git
Machine Learning
Английский язык
Linux
Software Development
Azure