Lead Azure Solutions Architect Trillium Staffing Solutions Somerville, MA Full Time

[Kate]

Now hiring a Lead Azure Solutions Architect for direct-hire!Trillium Technical is now seeking a Lead Azure Solutions Architect for direct-hire placement! We are looking for an accomplished Big Data Architect with strong experience in the Azure, Cloud Data lake architecture and implementation. This role will involve a close collaboration with our team of passionate and innovative big data specialists, application developers and product managers. This is a unique opportunity to be a Lead Architect in our Corporate Data Engineering Team, tackling our toughest and most exiting data lake challenges across multiple divisions in the firm. Job duties: • Design, Develop, construct, test and maintain architectures such as Data Lake, large-scale data processing systems • Big data ecosystem related Tool selection and POC analysis • Gather and process raw data at scale that meet functional / non-functional business requirements (including writing scripts, REST API calls, SQL Queries, etc.) • Develop data set processes for data modeling, mining and production • Integrate new data management technologies (Collibra, Informatica DQ..) and software engineering tools into existing structures • The candidate will be responsible for leading Architecture for building a new Data Lake, expanding and optimizing our data platform and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. • The individual will lead solution implementation leading and collaborating with our Software Developers, Database Architects, Data Analysts and Data Scientists on Big data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. • Build the Cloud Big data infrastructure required for optimal extraction, transformation, and loading of data from traditional/legacy data sources. • Work with stakeholders including the Management team, Product owners, and Architecture teams to assist with data-related technical issues and support their data infrastructure needs. • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. If interested, please apply today!• 5-7 Years of experience architecting and building Cloud Data Lake, specifically Azure Data Analytics technologies and architecture is desired, Enterprise Analytics Solutions, and optimizing 'big data' data pipelines, architectures and data sets. • 5 years of experience leading Scrum teams, Architects, Technology professionals • Advanced hands-on SQL, Spark, Python, Scala, pySpark (2+ of these) knowledge and experience working with relational databases for data querying and retrieval. • Experience with Design and Architecture of Azure big data frameworks/tools: Azure Data Lake, Azure Data Factory, Azure Data Bricks, Azure ML, SQL Data Warehouse, Azure Data Bricks.. • Experience with Design and Architecture of Apache Hadoop big data frameworks/tools: Hadoop, Kafka, Spark, etc. • Experience with Design and Architecture of relational SQL and NoSQL databases, including MS SQL Server, Cosmos DB • Experience with Design and Architecture of data security and Azure security, VM, Vnet • Experience with building processes supporting data transformation, data structures, metadata, dependency and workload management. • Experience leading and working with cross-functional teams in a dynamic environment. • Experience building Big data pipeline with Spark and/or Data Bricks is a plus. • 5-7 Years of Experience with Hadoop based technologies (e.g. hdfs, Spark). Spark Experience desirable • Strong SQL skills on multiple platform (preferred MPP systems) • Leading development of Data Lake Architectures from scratch • Data Modeling tools (e.g. Erwin, Visio) • 5+ years of Programming experience in Python, SQL, Spark • Experience with Azure DevOps/CI-CD, Continuous integration and deployment • Experience with Real time analytics on Spark, Kafka, Event Hub is a plus • Experience in petabyte scale data environments and integration of data from multiple diverse sources • Cloud advanced analytics – Azure ML, machine learning, text analysis, NLP is a plus • Healthcare experience, most notably in Clinical data, Epic, Clarity, Payer data and reference data is a plus but not mandatory #CBT

Recommended Skills​

Data Pipeline

Pyspark

Big Data

Data Modeling

Architecture

Dataflow