Spark/Big Data-Lead Developer
Contract Corp-To-Corp, 1.2 years
Spark/Big Data-Lead Developers
Primary Skill (Spark, Scala, SQL)
On a scale of 10, atleast 9 on Scala. (Primary Skill)
On a scale of 10, atleast 6 on Spark skills. (Primary Skill)
On a scale of 10, atleast 6 on SQL skills. (Primary Skill)
Most importantly they need to be very strong hands on Java developers.
They will be writing their own new projects and will be expected to build their own with Docker and Openshift CI/CD pipelines.
Migration of data sources and reporting from Netezza (and other databases) to Hadoop Environment
Reverse engineer existing data flows to migrate from legacy designs to best practice approach.
Detect, diagnose, and repair data quality errors and identify and implement technical and process improvements to prevent future data quality errors
The desired candidate will have hands on experience e in many of the following areas
Unix, ETL Processing, Hadoop (Cloudera), Impala / Hive / HBase, Solace/Tibco or other RT messaging services, FIX/FPML messages, TeamCity/uDeploy (or other suitable enterprise CI/CD)
Financial Markets experience