Ram Prakash Bakthinarayanan

Start date : 03/23/2020-Present

Technologies Used: Apache Spark/Apache Druid/Google Cloud/Scala/Hive/Thoughtspot/Sqoop/Unix shell programming/GPU

• Design and develop scalable and complex data pipelines using Apache Spark and Hive to load the pre-consumption table
• Migrated ETL flows that used Spark 2.0 major version to utilize Spark 3.0
• Utilizing GPU accelerators to enhance the ETL performance
• Develop SQOOP scripts to load data from various RDBMS to Hadoop
• Developed and supported datasources in Druid
• Develop Thoughtspot worksheets, pins and pinboards
• Developed data pipelines using Data proc as service
• Design and develop the Automic workflows to execute the developed ETL flows and decide the optimal time for workflow execution
• Involved in migrating workflows using Airflow from Automic
• Designed and developed ETL flows to support a web application (MerchOne) used by Merchants in Walmart.
• Responsible for reviewing the code deliverables in the scrum team.
• Works closely with product teams and other stakeholders in converting the business requirements into technical implementation documents.

Start date : 08/19/2019-Present

Technologies Used: Hive/Thoughtspot/Sqoop/Unix shell programming

Client: Walmart labs

• Design and develop scalable and complex hive queries to load the pre-consumption table
• Develop SQOOP scripts to load data from Teradata to HDFS
• Develop Thoughtspot worksheets, pins and pinboards
• Defect/Bug fixes in non prod and in production environment tracked in Jira through tickets
• Design and develop the Automic workflows to execute the developed ETL flows and decide the optimal time for workflow execution
• Track and maintain performance metrics and resource usage for key application processes using Resource manager and Ambari

Start date: 02/25/2019 End date: 08/16/2019

Client: Walmart labs

Technology Stack: Apache Hive/Apache Spark/yaml/Shell scripting/Jira/Github/Google cloud/Microsoft Azure

Application: Datalake project

The primary objective is to handle load the data from various sources like Oracle, Teradata, DB2 and Informix into datalake, Azure and Google cloud platform.

• Design and develop near realtime data streaming using Kafka and PySpark programs after loading the sufficient history data
• Develop Hive programs to transform the data and load in Datalake
• Performing ETL by ingesting data from Kafka into Hive
• Develop yamls to push data from datalake to Azure and Google cloud platform
• Develop Sqoop to pull data from various sources
• Develop Workflows and jobs in Automatic scheduler to execute the yamls
• Prioritize work based on Jira tickets
• Used Github as version control

Start date: 03/01/2019 End date: 02/22/2019

Client: Kaiser Permanente

Technology Stack: Apache Hive/Pyspark/Spark SQL/Apache Oozie/Oracle PLSQL/Perl/Shell programming/AWS

Application: MBE (Medicare Business Engine)

The primary objective of MBE is to handle Medicare members throughout Kaiser. Membership, benefits and CMS compliance letters are the major areas in MBE. The data from MBE applications are ingested in datalake.

• Performed analysis on existing systems, recommended enhancements, and implemented strategies to streamline current processes
• Develop Sqoop and Hive scripts to load data from Oracle to datalake(Hadoop)
• Worked with Oracle GoldenGate and Kafka for streaming data
• Develop spark programs to find the data quality after loading into staging tables
• Develop scripts to ingest the data into cloud buckets in AWS.
  Cloud Platform from datalake
• Develop dashboards using Tableau based on business requirements
• Developed User-defined functions in Python for complex transformations
• Develop shell scripts to invoke the hive scripts
• Co-ordinate with scheduling team to schedule unix jobs
• Represented development team at the client meetings
• Work closely with clients to establish problem specifications and system designs
• Developed complex database views in Oracle PLSQL which then used by sqoop to extract the data
• Performed performance tuning on existing views in Oracle SQL
• Work in onsite-offshore model and leads the team for delivery

Client: Kaiser Permanente

Technology Stack: Oracle PLSQL/Unix/Informatica

Application: Claims Xcelys/Diamond

The primary objective of Xcelys and Diamond are to handle Claims processing, claim adjudication and member benefit accumulation.

• Develop and maintain Oracle DB jobs running in LINUX OS which are scheduled through Tivoli Workload scheduler
• Developed and maintain ETL workflows for generating reports using Informatica 9.1

Client: Kaiser Permanente

Technology Stack: Oracle PLSQL/Unix/Java

Application: Claims Xcelys/Diamond

The primary objective of Xcelys and Diamond are to handle Claims processing, claim adjudication and member benefit accumulation.

• Developed code fixes and enhancements for inclusion in future code releases and patches in Oracle PLSQL.Design,Development,Maintenance and support of Diamond application
• Involved in the architecture and design of the application using J2EE Design Patterns like Observer, Builder, singleton
• Used IBM MQ for receiving messages from various interfaces
• Used IBM TWS for scheduling batch jobs

• Trained in the basic and advanced concepts of core Java & Java EE along with frameworks like Hibernate, Spring and SOA
• Extensively worked on front end, business, and persistence tiers using the struts frameworks
• Involved in design, development, and testing phases of software development life cycle
• Developed presentation layer using Java script, struts tag libraries like logic, html, bean, etc. in JSP pages
• Used GitHub as Version Control System