Our client is a provider sponsored health insurance company that insures 1.2 million members in New York City and downstate New York. They are an innovative company and are at forefront of value-based healthcare and are looking for people who relish working a complex environment, are passionate about data and applying their skills to helping us provide health insurance to an underserved population. The Data Engineer will bring their expertise in designing and developing highly robust, repeatable and scalable workflow patterns to ingest, integrate and publish a wide variety of data from internal and external sources. They will be relentless in their focus on delivery and end ensuring that our data workflows and pipelines are enterprise-grade – reliable, scalable and secure. Responsibilities include:
Minimum Qualifications:
Extract Transform Load (Etl)
Data Transformation
Big Data
Information Security
Workflows
- Designing, implementing, maintaining highly robust, scalable and flexible ETL jobs and data workflows
- Automating workflows leveraging DevOps framework where applicable
- Ensuring quality of technical solutions as data moves across environments
- Working with solution and data architects to develop, construct, test and maintain architectures, prototypes and design solutions
- Helping to maintain the integrity and security of the company data
- Providing insight into the changing data environment, data processing, data storage and utilization requirements for the company and offer suggestions for solutions
- Articulating both the technical implications as well as data usage implications of proposed solutions or solution options to a wide variety of stakeholders.
- Working directly with business users to align solutions with business requirements
- Relentless focus on continuous improvement of solutions in to improve data reliability, efficiency, quality and more
- Create data monitoring capabilities for each business process and work with data consumers on updates
- Collaborating with cross functional teams comprised of technical and business colleagues
Minimum Qualifications:
- 5 + years’ experience in a data engineering
- Experience in the development of data platforms such as data warehouse, data lakes, data marts etc.
- Proficiency in SQL a must - knowledge of SQL and multiple programming languages in order to optimize data processes and retrieval
- 5+ years’ experience in data programing languages such as Python or Spark
- 5+ years’ experience working in a Big Data ecosystem processing data; includes file systems, data structures/databases, automation, security, messaging, movement, etc.
- 3+ years’ experience working in a production cloud infrastructure
- Prior backgrounds with AWS services (e.g. lambda, S3, Aurora, Redshift);
- Exposure to CI/CD for software systems
- Must be able to develop creative solutions to problems
- Demonstrates critical thinking skills with ability to communicate across functional departments to achieve desired outcomes
- Ability to work independently and as part of a team
- Skilled in Microsoft Office including Project, PowerPoint, Word, Excel and Visio
- Hands on experience in leading healthcare data transformation initiatives from on-premise to cloud deployment
- Demonstrated experience working in an Agile environment as a Data Engineer
- Experience with other Cloud Data Warehouses (Big Query, Snowflake);
- Knowledge of provider-sponsored health insurance systems/processes and the Healthcare industry
- Proficiency with graph and noSQL databases
Recommended Skills
Data WarehousingExtract Transform Load (Etl)
Data Transformation
Big Data
Information Security
Workflows