Our client, an industry leader in Houston, is looking for a Data Engineer on a long-term contract basis.
US Citizen or Green Card Required (no exceptions)
Candidates should be local and able to come into the office (north Houston) once Covid restrictions are lifted.
Data Engineer
Required:
Hdinsight
Data Ingestion
Apache Hive
Map Reduce
Mobile Device Management
US Citizen or Green Card Required (no exceptions)
Candidates should be local and able to come into the office (north Houston) once Covid restrictions are lifted.
Data Engineer
Required:
- 5+ years of consulting or client service delivery experience on Azure
- 5+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions
- Extensive hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
- Cloud migration methodologies and processes including tools like Azure Data Factory, Data Migration Service, SSIS, Attunity (Qlik), Event Hub, Kafka, etc.
- 5+ years of RDBMS experience (SQL Server preferred)
- Experience with analysis of private and public cloud architectures (pros/cons) and migration considerations
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure
- IoT, event-driven, microservices, Containers/Kubernetes in the cloud
- Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
- Familiarity with the technology stack for data management, data ingestion, capture, processing and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc.
- Multi-cloud experience a plus - Azure, AWS, Google
- Proven ability to build, manage and foster a team-oriented environment
- Proven ability to work creatively and analytically in a problem-solving environment
- Desire to work in an information systems environment
- Excellent communication (written and oral) and interpersonal skills
- Excellent leadership and management skills
- Excellent organizational, multi-tasking, and time-management skills
- Proven ability to work independently
Recommended Skills
Big DataHdinsight
Data Ingestion
Apache Hive
Map Reduce
Mobile Device Management