Career Profile
Around 14 years of experience in building highly scalable full stack enterprise applications using Java/J2EE and various distributed Big Data technologies
Summary
- Expertise in implementing real time data ingestion and processing pipelines for data analytics using Spark, Kafka, Hapoop and other big data technologies
- Managing and leading project development team for scoping, technical architecture, design and implementation
- Ability to design and deploying dynamically scalable, highly available and fault-tolerant application in AWS cloud using various AWS services
- Experience is building micro services using container orchestration and management system like kubernetes, Docker on-premise and on cloud using AWS services
- Expertise and in-depth knowledge in Apache Kafka eco-system involving Kafka producer, consumer, brokers, administration, Kafka Connect, Kafka Streams, Schema registry, Avro Serialization.
- Experience in using NOSQL databases like Mongo DB and Cassandra and RDBMS like Oracle and MySql
- Experise in identifyig performance bottlenecks and improving throughput and latencies in data pipelines and enterprise applications
- Proficiency with software engineering practices such as UML Modeling, Use Case analysis, Refactoring, code quality measurement and analysis using static code analysis tools
Skills & Proficiency
Languages
Java & Scala
Javascript & jQuery
PL/SQL
Python
Angular/Node JS
Distributed Computing
Hadoop/Map Reduce
Apache Kafka
Apache Spark
Apache Hive
Apache Livy
Apache zeppelin
PIG script
Cloud / Container orchestration
AWS
Docker
Kubernetes
Database
Oracle
Cassandra
MongoDB
Neo4j
Experiences
Lead Data engineering for design ,implementation and enhancements of Apple’s iCloud data analytics platform
- Technology used - Core Java, Apache spark, Apache Zeppelin, Livy server, Kafka, Hadoop Map- Reduce and Apache Kafka, AWS services and various other big data technologies
Administration and enhancement of Apache Kafka Brokers for Apple’s iCloud reporting system
- Technology used - Apache Kafka
Team management and weekly update of the reporting team members to the stack holders
Developed from scratch a highly scalable ingestion pipeline for real time streaming of millions of transactions for Apple’s iCloud analytics and reporting system
- Technology used - Core Java, Netty, Java restful services, Java NIO , multithreading framework, Apache Kafka, Kafka connect ,Cassandra , Avro serialization framework and Hadoop system.
Developed client API in Core Java which is used by various iCloud applications like iMessage, Calendar, FindMyPhone etc for ingesting the transactions into iCloud reporting ingesting service for reporting purpose
- Technology used - Core Java, Java NIO , multithreading framework, Apache Kafka and Avro serialization
Developed schema registry service using Core java and Cassandra as schema store which is used by various internal iCloud components for querying and resolving Apache Avro schema
- Technology used - Cassandra, Apache Avro, Core Java, JAX-RS
Developing business reports of iCloud data using Hadoop pig scrips and Map-Reduce programing
Development and enhancement of monitoring and alerting systems for ETL and Streaming pipeline for tracking and fault identification using Map-reduce programing, Core Java , Hadoop and Java Script and Node JS
Developed various deployment and testing scripts using unix shell scripting
Developed internet facing website for Capital One’s Loan Origination system which takes applications from end customers applying for auto loan from Capital One bank. Applicants can apply loan application to Capital One , followed by approval and funding process.The website is highly scalable and caters to thousands of applications per hour.
- Technology used - Spring MVC, Core Java, JavaScript, Ajax, jQuery, Design Patterns, JAX-WS web- services, PL/SQL, JAXB/JAXP, Maven, WebLogic server
Developed services for verification, approval and funding process of auto loan applications . Once the applicants apply for auto loan application through internet or through dealer app, the application goes through the verification, approval and funding process during which applicants data and documents are verified by calling various external services , post which the applicants credit score is evaluated by calling different credit bureau and ingested into decisioning engine and goes through approval process for APR calculation if the application is approved . Post approval, the application moves to funding process and application is finally funded.
- Technology used - Core Java, JAX-WS , EJB, JAXB/JAXP, PL/SQL, Design patterns, Java Script Ajax, jQuery, Capstone, Business Rules Engine, WebLogic, Maven, Shell scripting, JMS, Savvion/Progress
Developed centralized authentication web service which authenticates and authorizes users based on their roles which is used by various internal Capital One’s systems
- Technology used - Core Java, XML, JAX-WS, LDAP apis , Oracle, PL/SQL, Weblogic server
Worked on enhancement of various components involved in British Telecom’s network service provisioning system , primarily worked on development on network service order decomposition system which decomposes network service order into multiple order lines for providing connection to various host services ( like MPLS and VPN )
- Technology used - Core Java, Spring, PL/SQL and XML technologies
Developed order tracking system for British Telecom’s network service provisioning system for tracking and monitoring faults in the order using J2EE technologies
- Technology used - Core Java, SPRING, Web-logic server ,Ajax , Java Script Oracle and PL/SQL