Ref ID: 04130-0011875795
Classification: Big Data Engineer
Compensation: $85000.00 to $140000.00 yearly
As a Data Engineer you will develop and maintain scalable data pipelines while collaborating with analytical and business teams to improve data models.
Responsibilities:
● Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
● Writes unit/integration tests, contributes to engineering wiki, and documents work.
● Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
● Works closely with a team of frontend and backend engineers, product managers, and analysts.
● Defines company data assets (data models), and other jobs to populate data models.
● Designs data integrations and data quality framework.
● Designs and evaluates open source and vendor tools for data lineage.
● Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
Minimum Qualifications:
● Preferable to have a Degree in an analytical field (e.g. Computer Science, Mathematics, Statistics, Engineering, Operations Research, Management Science) and 4+ years of professional experience.
● At least 4 years of data analytics experience in a distributed computing environment
● Database maintenance
● Building and analyzing dashboards and reports
● Evaluating and defining metrics and perform exploratory analysis
● Monitoring key product metrics and understanding root causes of changes in metrics
● Empower and assist operation and product teams through building key data sets and data-based recommendations
● Automating analyses and authoring pipelines via SQL/python based ETL framework
● Superb SQL programming skill.
● Understanding of ETL tools and database architecture.
● Advanced knowledge of data warehousing.
● Strong knowledge of code and programming concepts. Experience with Python.
● Experience with Kubernetes deployments and DevOps approach
● Highly motivated self-starter who is flexible and goal oriented
● Strong Python Knowledge with Data Models, Object-Oriented Programming, Testing (Unit / Regression)
● Database Experience Window Functions, Partitioning/Indexes, Relational and Non-Relational
● Big Data Experience with Hadoop, Spark , and/or DataFrame API
● Performance Benchmarking Cluster Configuration/Optimization or Spark Optimzation
● Version Control, CI/CD ,Git or Jenkins, Drone
● Some Cloud Experience AWS (primary), Azure, Google Cloud
PySpark, Python, Apache Kafka
Robert Half Technology matches IT professionals with remote or on-site jobs on a temporary, project or full-time basis. From roles in software and applications to IT infrastructure and operations, we provide you unparalleled access to exciting career opportunities.
Our experienced staffing professionals can promote you to employers and advocate on your behalf. We provide access to top jobs, competitive compensation and benefits, and free online training. For more opportunities, get the Robert Half app and receive instant notifications when our AI matches you with jobs.
When you work with us, you’re working with the best. Robert Half has been recognized as one of FORTUNE’s “Most Admired Companies” every year since 1998 and was named to Forbes’ inaugural list of America’s Best Temporary Staffing Firms.
Questions? Call your local office at
1.888.490.4429
. All applicants applying for U.S. job openings must be authorized to work in the United States. Benefits are available to temporary professionals. Visit [ Link removed ] - Click here to apply to Data Engineerfor more information.
© 2020 Robert Half Technology. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (www.roberthalf.com/terms-of-use).
Big Data
Data Quality
Dashboard
Extract Transform And Load (Etl)
Data Analysis
Classification: Big Data Engineer
Compensation: $85000.00 to $140000.00 yearly
As a Data Engineer you will develop and maintain scalable data pipelines while collaborating with analytical and business teams to improve data models.
Responsibilities:
● Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
● Writes unit/integration tests, contributes to engineering wiki, and documents work.
● Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
● Works closely with a team of frontend and backend engineers, product managers, and analysts.
● Defines company data assets (data models), and other jobs to populate data models.
● Designs data integrations and data quality framework.
● Designs and evaluates open source and vendor tools for data lineage.
● Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
Minimum Qualifications:
● Preferable to have a Degree in an analytical field (e.g. Computer Science, Mathematics, Statistics, Engineering, Operations Research, Management Science) and 4+ years of professional experience.
● At least 4 years of data analytics experience in a distributed computing environment
● Database maintenance
● Building and analyzing dashboards and reports
● Evaluating and defining metrics and perform exploratory analysis
● Monitoring key product metrics and understanding root causes of changes in metrics
● Empower and assist operation and product teams through building key data sets and data-based recommendations
● Automating analyses and authoring pipelines via SQL/python based ETL framework
● Superb SQL programming skill.
● Understanding of ETL tools and database architecture.
● Advanced knowledge of data warehousing.
● Strong knowledge of code and programming concepts. Experience with Python.
● Experience with Kubernetes deployments and DevOps approach
● Highly motivated self-starter who is flexible and goal oriented
● Strong Python Knowledge with Data Models, Object-Oriented Programming, Testing (Unit / Regression)
● Database Experience Window Functions, Partitioning/Indexes, Relational and Non-Relational
● Big Data Experience with Hadoop, Spark , and/or DataFrame API
● Performance Benchmarking Cluster Configuration/Optimization or Spark Optimzation
● Version Control, CI/CD ,Git or Jenkins, Drone
● Some Cloud Experience AWS (primary), Azure, Google Cloud
PySpark, Python, Apache Kafka
Robert Half Technology matches IT professionals with remote or on-site jobs on a temporary, project or full-time basis. From roles in software and applications to IT infrastructure and operations, we provide you unparalleled access to exciting career opportunities.
Our experienced staffing professionals can promote you to employers and advocate on your behalf. We provide access to top jobs, competitive compensation and benefits, and free online training. For more opportunities, get the Robert Half app and receive instant notifications when our AI matches you with jobs.
When you work with us, you’re working with the best. Robert Half has been recognized as one of FORTUNE’s “Most Admired Companies” every year since 1998 and was named to Forbes’ inaugural list of America’s Best Temporary Staffing Firms.
Questions? Call your local office at
1.888.490.4429
. All applicants applying for U.S. job openings must be authorized to work in the United States. Benefits are available to temporary professionals. Visit [ Link removed ] - Click here to apply to Data Engineerfor more information.
© 2020 Robert Half Technology. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (www.roberthalf.com/terms-of-use).
Recommended Skills
Data WarehousingBig Data
Data Quality
Dashboard
Extract Transform And Load (Etl)
Data Analysis