BigData Java/SPARK Technical Lead/Architect
Full Time
Depends on Experience
BigData Java/SPARK Technical Lead/Architect
• Candidate should have 8+ years of Strong experience in Spark with BigData, Core Java, Hive, Hbase/Phoenix and other related Hadoop technologies. Should have sound knowledge on creating Spark jobs for data transformation and aggregation and produce unit tests for Spark transformations and helper methods
• Should have prior experience in sourcing, transforming and analyzing vast amount of raw data from various systems using Spark to provide ready-to-use data to business team.
• Sound knowledge about Hadoop ecosystem. Hands-on experience in Map-Reduce, Hive, Hue, Yarn, Sqoop and Oozie
• Have strong knowledge on Design Patterns used in Big Data.
• Should have hands-on experience in Java/J2EE, REST Services, NodeJS, SprintBoot, Spring MVC, Hibernate
• Hands on expertise in Core Java – specifically collections, Multithreading, Design Patterns, OOPS concepts.
• Familiar with development tools such as Jenkins, Git/Bitbucket, Jira, etc.
• Experience in the creation of data policies, standards, reference patterns, data models around various data integration and data consumption capabilities.
• Experience with various data modeling and design patterns around operation data stores and data warehouse.
• Experience with performance identification and enhancement techniques on Spark and other related BigData technologies
• Working knowledge of next generation data platforms including Streaming technologies, Kafka, Spark, NoSQL, GraphdB, Data Virtualization, in-memory datastores and self-service data platforms
• Demonstrates the ability to provide technical leadership on large complex data integration projects with strategic vision and can articulate the tradeoffs and recommendations as needed.
• A keen understanding on how security controls are positioned and how they relate to the overall systems architecture
• Experience in the financial industry preferred
• TOGAF certified (plus)
• Core, Advance Java, Apache Spark Certifications (preferred and plus)
• Experience delivering solutions using an Agile/Scrum methodology
• Exceptional interpersonal skills, including teamwork, facilitation and communication
• Bachelor’s degree in MIS, Computer Science, Programming, Engineering, OR a related discipline with an advanced degree preferred, or its equivalent.