Job Title: Azure Cloud Engineer - Big Data
Location: Tampa, FL.
Job Type: 6 - 12 months contract
NOTE: Must have skills:
Azure Expert Certification is a MUST
Azure DevOps
Azure Databricks/Spark, Azure Data Factory
JOB DETAILS:
Skills Required:
• Minimum 5 years of experience as Cloud Engineer
• Experience with Git/Azure DevOps
• Experience in business processing mapping of data and analytics solutions
• Experience with Azure Data & Analytics PaaS Service; Azure Data Factory, Azure Data Lake, Azure SQL DW and Azure SQL
• Experience with Visual Studio, PowerShell Scripting and ARM Templates Knowledge of Azure DataBricks, Azure Cosmos DB and Azure Stream Analytics, Azure Event Hubs, Azure Service Bus.
• Strong data design skills when persisting data sets in Azure Data Lake
• Strong working knowledge of Python
• Strong working knowledge of Azure Databricks/Spark, Azure Data Factory
• Strong exposure to Azure Data Lake Storage technologies Gen1/Gen2
• Knowledge of expose data to end-users using Azure API Apps or other modern visualization platform
• Ability to conduct data profiling, cataloging and mapping for technical design and construction of technical data flows
• Knowledge of Lambda and Kappa architecture patterns
• Knowledge of Master Data management (MDM) and Data Quality tools and processes
• The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams and system integration
• Knowledge of partitioning, various file formats like ORC, Parquet, JSON and CSV
• Knowledge of building data pipeline using Kafka streaming and KSQL DB
• Comfortable with large data sets in the order of Terabytes
• Understanding of Azure storage services Blob, File, Table and Queue
• Demonstrated experience preparing data and building data pipelines for Al Use Cases (text, voice, image, etc…)
• Designing and building Data Pipelines using streams of data
• Excellent communication skills (written and verbal), as well as an ability to follow standards
• Degree in Applied Mathematics, Statistics, Analytics, Operations Research, Economics/Econometrics, Engineering or another related field is preferred.
Special Requirement:
• Azure Expert Certification is a MUST
• Minimum 5 years of experience in Azure Cloud
• One or more of the Microsoft Azure role based certifications
Work Description:
• Create and maintain optimal data pipelines
• Ability to create real-time and even driven data pipelines
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Automate pipeline deployments using Azure DevOps across lifecycles
• Automate testing by using DevOps build pipeline
• Ability to analyze structured and un-structured data sets
• Working with different security teams and maintain a log of operational activities performed
• Develop, maintain and drive a culture of continuous enhancement
• Establish a continuous improvement plan for Cloud Operations, including technology, reviews, root cause analysis, action reports analysis and cloud portfolio review in order to ensure adequate infrastructure to provide suitable operating environment(s) for critical applications.