Ref ID: 04951-0011810399
Classification: Big Data Engineer
Compensation: $57.00 to $66.00 hourly
Sr. Data Engineer
As a Sr. Data Engineer you will be part of the Data Engineering team responsible for developing and deploying Engineering and Integration solutions. Primary responsibility will be to work closely with the Data Architects and Machine Learning Team to implement data solutions for the organization using Python, Java, Kafka and other big data solutions, creating technical specification documents and test plans. Also provide support for the data solutions across the enterprise.
Your primary responsibilities will include:
• Work with business users, technology teams, and executives to understand their data needs to create innovative solutions to fulfil them
• Design, organize, and implement data structures, workflows, and integrations between enterprise platforms to ensure the accurate and timely execution of business processes.
• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Guide decisions and establish best practices on data integration/engineering, as well as the future of our data infrastructure
• Manage and improve the performance of our database, queries, tools, and solutions
• Create and maintain data warehouse, databases, tables, SQL queries, and ingestion pipelines to power reports(Tableau), dashboards, predictive models, and downstream analysis
• Write complex and efficient queries to transform raw data sources into easily accessible models for our teams and reporting platforms
• Prepare data for predictive and prescriptive modeling
• Identify and analyze data patterns
• Identify ways to improve data reliability, efficiency and quality
• Work with analytics, data science, and wider engineering teams to help with automating data analysis and visualization needs, advise on transformation processes to populate data models, and explore ways to design and develop data infrastructure
• Other duties as assigned
Streaming Data, Streaming Technologies, Streaming Data, Streaming Technologies, Python, Open Source, Apache OpenJPA
REQUIREMENTS
• Minimum Bachelor’s degree in computer science, information technology, or a similarly relevant field.
• Minimum 5 years of data engineering experience preferred.
• Minimum of 3 years of experience with OOP, SQL, schema designing, data modeling, designing, building, and maintaining data processing systems
• Strong experience with advanced analytics tools for Object-Oriented/object function scripting using languages such as R, Python, Java, others.
• Strong ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management.
• Database development experience using SQL, SPARK, or BigQuery and experience with a variety of relational, NoSQL oriented databases like Hadoop, MongoDB, Cassandra
• Big Data Development experience using Hive, Impala, Spark, and familiarity with Kafka (preferred)
• Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics
• Extensive experience in triaging data issues, analyzing end-to-end data pipelines and working with business users in resolving issues.
• Experience in working with data governance/data quality and data security teams and specifically data stewards and security officers in moving data pipelines into production with appropriate data quality, governance and security standards and certification.
• Adept in agile methodologies and capable of applying DevOps and increasingly DataOps principles to data pipelines.
• Exposure to containerization using Docker, Kubernetes etc.
• Understanding business processes and how they are modeled in various systems
• Ability to work with both IT and business in integrating analytics and data science output into business processes and workflows.
Robert Half Technology matches IT professionals with remote or on-site jobs on a temporary, project or full-time basis. From roles in software and applications to IT infrastructure and operations, we provide you unparalleled access to exciting career opportunities.
Our experienced staffing professionals can promote you to employers and advocate on your behalf. We provide access to top jobs, competitive compensation and benefits, and free online training. For more opportunities, get the Robert Half app and receive instant notifications when our AI matches you with jobs.
When you work with us, you’re working with the best. Robert Half has been recognized as one of FORTUNE’s “Most Admired Companies” every year since 1998 and was named to Forbes’ inaugural list of America’s Best Temporary Staffing Firms.
Questions? Call your local office at
1.888.490.4429
. All applicants applying for U.S. job openings must be authorized to work in the United States. Benefits are available to temporary professionals. Visit [ Link removed ] - Click here to apply to Data Engineerfor more information.
© 2020 Robert Half Technology. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (www.roberthalf.com/terms-of-use).
Big Data
Data Quality
Data Integration
Data Governance
Data Modeling
Classification: Big Data Engineer
Compensation: $57.00 to $66.00 hourly
Sr. Data Engineer
As a Sr. Data Engineer you will be part of the Data Engineering team responsible for developing and deploying Engineering and Integration solutions. Primary responsibility will be to work closely with the Data Architects and Machine Learning Team to implement data solutions for the organization using Python, Java, Kafka and other big data solutions, creating technical specification documents and test plans. Also provide support for the data solutions across the enterprise.
Your primary responsibilities will include:
• Work with business users, technology teams, and executives to understand their data needs to create innovative solutions to fulfil them
• Design, organize, and implement data structures, workflows, and integrations between enterprise platforms to ensure the accurate and timely execution of business processes.
• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Guide decisions and establish best practices on data integration/engineering, as well as the future of our data infrastructure
• Manage and improve the performance of our database, queries, tools, and solutions
• Create and maintain data warehouse, databases, tables, SQL queries, and ingestion pipelines to power reports(Tableau), dashboards, predictive models, and downstream analysis
• Write complex and efficient queries to transform raw data sources into easily accessible models for our teams and reporting platforms
• Prepare data for predictive and prescriptive modeling
• Identify and analyze data patterns
• Identify ways to improve data reliability, efficiency and quality
• Work with analytics, data science, and wider engineering teams to help with automating data analysis and visualization needs, advise on transformation processes to populate data models, and explore ways to design and develop data infrastructure
• Other duties as assigned
Streaming Data, Streaming Technologies, Streaming Data, Streaming Technologies, Python, Open Source, Apache OpenJPA
REQUIREMENTS
• Minimum Bachelor’s degree in computer science, information technology, or a similarly relevant field.
• Minimum 5 years of data engineering experience preferred.
• Minimum of 3 years of experience with OOP, SQL, schema designing, data modeling, designing, building, and maintaining data processing systems
• Strong experience with advanced analytics tools for Object-Oriented/object function scripting using languages such as R, Python, Java, others.
• Strong ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management.
• Database development experience using SQL, SPARK, or BigQuery and experience with a variety of relational, NoSQL oriented databases like Hadoop, MongoDB, Cassandra
• Big Data Development experience using Hive, Impala, Spark, and familiarity with Kafka (preferred)
• Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics
• Extensive experience in triaging data issues, analyzing end-to-end data pipelines and working with business users in resolving issues.
• Experience in working with data governance/data quality and data security teams and specifically data stewards and security officers in moving data pipelines into production with appropriate data quality, governance and security standards and certification.
• Adept in agile methodologies and capable of applying DevOps and increasingly DataOps principles to data pipelines.
• Exposure to containerization using Docker, Kubernetes etc.
• Understanding business processes and how they are modeled in various systems
• Ability to work with both IT and business in integrating analytics and data science output into business processes and workflows.
Robert Half Technology matches IT professionals with remote or on-site jobs on a temporary, project or full-time basis. From roles in software and applications to IT infrastructure and operations, we provide you unparalleled access to exciting career opportunities.
Our experienced staffing professionals can promote you to employers and advocate on your behalf. We provide access to top jobs, competitive compensation and benefits, and free online training. For more opportunities, get the Robert Half app and receive instant notifications when our AI matches you with jobs.
When you work with us, you’re working with the best. Robert Half has been recognized as one of FORTUNE’s “Most Admired Companies” every year since 1998 and was named to Forbes’ inaugural list of America’s Best Temporary Staffing Firms.
Questions? Call your local office at
1.888.490.4429
. All applicants applying for U.S. job openings must be authorized to work in the United States. Benefits are available to temporary professionals. Visit [ Link removed ] - Click here to apply to Data Engineerfor more information.
© 2020 Robert Half Technology. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (www.roberthalf.com/terms-of-use).
Recommended Skills
DashboardBig Data
Data Quality
Data Integration
Data Governance
Data Modeling