We are looking for a strong BigData Engineer who will be responsible and owning the data processing pipelines withing Regulatory Reporting platform of Citi. The candidate will be responsible for architecture & full Software Development Lifecycle, code reviews, unit test case writing and ensure code developed meets the requirements, component design/coding/unit testing/debugging. To succeed in this role the candidate should possess a natural analytical skill, an innovative thinker who can provide efficient & effective solutions to complex Technology & Business problems.
Key Responsibilities include:
• Ownership and responsibility for end-to-end design and development, testing, release of key components & sprint planning.
• Solid experience designing partitioned and non-partitioned tables, indexes, temporary tables and external tables to maximize storage and performance
• Responsible for Information Management in areas of Enterprise Architecture Planning, Data Governance, Master Data Management, and Data Warehousing.
• Ownership on design & implementation of scalable & fault tolerant ETL Pipelines on BigData Platform to store & process terabytes of contract information’s from upstream sources with high availability.
• Actively work on performance tuning techniques through understanding Spark DAG’s on data structures on both Relational & BigData Platforms giving high performance to both ETL & Reporting Components.
• Own the Release process through RLM & SNOW for all phases of SDLC for Relational & BigData Platforms.
• Ensure process compliance and manage expectations of the leadership
• Actively participate in brainstorming session and provide solid inputs to the team and ensure best practices are followed within the team.
• Provide full support to different groups like Dev, SIT & Prod Support on Data Governance, Modelling & maintenance.
Qualifications:
• Bachelor’s Degree (Technology related field) or equivalent work experience
• 6 + years of application/software development
• 5 + years’ experience with JAVA(Core Java, J2EE, Spring Boot Restful Services), Python, Web services (REST, SOAP), XML,  Java Script, Micro services, SOA etc
• 3 + Years of experience on BigData Technologies like Apache Spark , Hive, Hadoop & Storm.
• Knowledge on technologies like ELK, Docker, Kubernetes, Azure Cloud, AWS S3 etc
• Knowledge on NOSQL Databases like MongoDB, Hbase, Cassandra etc.
• Working experience with Financial application / Finance processes is a plus
• Experience with vendor products like Tableau, Arcadia, Paxata, KNIME is a plus
• Extensive years of working in a multi-cultural environment delivering results with virtual teams.
• A well-diversified background with a successful track record of leadership, experience, and performance
• Ability to work independently, multi-task, and take ownership of various analyses or reviews
#LI-AS1
-------------------------------------------------
Job Family Group:
Technology
-------------------------------------------------
Job Family:
Applications Development
------------------------------------------------------
Time Type:
------------------------------------------------------
Citi is an equal opportunity and affirmative action employer.
Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi .
View the " EEO is the Law " poster. View the EEO is the Law Supplement .
View the EEO Policy Statement .
View the Pay Transparency Posting