Apache Airflow, Apache Cassandra, Apache Hadoop, Apache Hive, Apache Kafka, Apache Spark, Automation, Banking, Big data, Cloudera, DevOps, GitHub, HDFS, Informatica, IntelliJ IDEA, Java, PL/SQL, PyCharm, Python, SQL, Web services
Full Time
Depends on Experience
Travel required to 25%.
PETADATA is looking for a Senior Big Data Engineer to work with one of our clients.
Job Location: Phoenix ,AZ|| Tampa, FL|| Boston MA|| San Francisco CA
Work Authorization: W2, Full-time
Experience: 12+years of experience required.
Visa : H1B Visa, TN Visa, , .
Requirements:
• Min 8 years of IT experience with ETL (informatica) , Oracle SQL/PLSQL, Unix/Shell scripts, Python
• Minimum 5 years of experience in Big Data Technologies with the following tech stack:
• Hadoop, HDFS, Apache Spark,
• HIVE / Habse / Cassandra ,Python / Java
• PySpark / Data Frames, Kafka ,SQL
• Tools like PyCharm, Intellij
• Apache Airflow, GitHub / Gitlab
• DevOps Automation
• Experience with cloudera / Hortonworks
• Experience with tools like Zeppelin, jupyterHub
Roles & Responsibilities:
• MUST have Banking/Financial data domain expertise (or worked on commercial/consumer loan systems)
• Must have financial/banking data domain implementation in data hub/data lake environments with
• creation of normalized/user access layer data models along with API development experience.
• Strong Implementation experience in Big data technologies.
• Strong Data analysis and debugging, Data mapping and data mining skills.
• Ability to analyze large amounts of data.
• SQL queries (Oracle SQL/PLSQL) and performance tuning.
• Experience working with different kinds of data sources and source files- XML, flat files.
• Strong experience in Data service through APIs/Web services.
Soft Skills:
• Strong ability to collaborate and communicate with senior leadership and business sponsors.
• Excellent and precise communication skills.
• Ability to lead and manage teams while being hands on provide technical/functional guidance.
• Good understanding of budgeting and planning.
Note:  Remote until Covid -19
If you are interested and meet the above job requirements, please submit your resume.
After carefully reviewing your experience and skills, one of our Hiring team members will
contact you on the next steps.