Etl/pentaho Developer Resume
Mclean, VA
SUMMARY
- Over 7 years of IT Experience in Database Design, Development and business intelligence of Microsoft SQL Server in Development, Test and Production Environments on various business domains.
- Highly experienced in Data Warehousing, ETL and Business Intelligence experience using Pentaho Suite (Pentaho Data Integration/Kettle, Pentaho BI Server, and Pentaho Analysis Tool & Mondrian OLAP).
- Experienced in developing Data Warehouse architecture, ETL framework and BI Integration using Pentaho Reports and Pentaho Dashboards.
- Proficient in writing T - SQL Statements, Complex Stored Procedures, Dynamic SQL queries, Batches, Scripts, Functions, Triggers, Views, Cursors and Query Optimization.
- Hands on experience in creating and debugging Stored Procedures, Functions, Packages, Triggers, Cursors and Object Types in PL/SQL using TOAD and Oracle SQL Developer.
- Over 2+ years of experience in MongoDB (versions 2.x, 3.0.0 and 3.0.5) installation, configuration.
- Experience with exception/error handling in PL/SQL.
- Experience in converting stored procedures, functions and triggers written in PL/SQL code into T-SQL.
- Responsible for performance tuning of stored procedures, Database Tables using Table Partitioning, SQL Profiler and Database tuning wizard.
- Hands on experience on the whole ETL (Extract Transformation & Load) process.
- Skilled in High Level Design of ETL DTS Package for integrating data from heterogeneous sources (Excel, CSV, Oracle, MySQL, flat file, Text Format Data).
- Hands-on experience in MS SQL Server Integration Services (SSIS), MS SQL Server Analysis Services (SSAS) and MS SQL Server Reporting Services (SSRS) using Business Intelligence development studio (BIDS).
- Worked on upgrading from DTS to SSIS packages.
- Experience in designing Database Models using Microsoft Visio and creating class diagrams, activity diagrams, use cases diagrams, sequence diagrams and flow charts.
- Worked on Notification services in setting up the Scheduled jobs and alerts.
- Hands-on experience on Data Warehouse Star Schema Modeling, Snow-Flake Modeling, FACT & Dimension Tables, Physical and Logical Data Modeling.
- Expertise in generating reports using SQL Server Reporting Services, Crystal Reports and Pivot Charts/Tables in MS Excel Spreadsheet.
- Deployed SSRS Reports on SQL Server Report Server as well as on SharePoint Server.
- Extremely motivated, diligent, conceptually strong team player with ability to take new roles and adapt quickly to new technology.
- Detail-oriented, results-driven, excellent verbal and written communication skills with interpersonal and conflict resolution skills and possesses strong analytical skills.
TECHNICAL SKILLS
Business Intelligence: Microsoft tools, Informatica, Data Stage & Pentaho BI Tools
Databases: Oracle, SQL Server, DB2, MySQL, MS Access, Vertica
Tools: MS Visio, SAS/Access, Crystal Reports Business Objects, Microsoft office, Tableau
Operating Systems: Windows 95/98/XP/Vista/7, Windows NT/2000, Server 2003
Programming Languages: T-SQL, PL/SQL C, C++, HTML, XML, MYSQL, Java
Query Tools: Toad, SQL Plus, SQL Developer, SQL Server Management Studio
FTP Tools: Putty, OPENPGP
Pentaho Suite: Pentaho Data Integration (Kettle), Pentaho BI Server, Pentaho Analysis Tool, Pentaho Report Designer, Pentaho Mondrian, Pentaho Metadata Editor, Pentaho Design Studio, Mondrian OLAP Server
PROFESSIONAL EXPERIENCE
Confidential, Mclean, VA
ETL/Pentaho Developer
Responsibilities:
- Develop solution for migrating data from legacy system into Oracle database.
- Lead architecture role in dealing with clients and program managers.
- Build Search Tool using REST APIs, Python andMongo DB.
- Loaded unstructured data into Hadoop File System (HDFS).
- CreatedETLjobs to load JSON data and server data intoMongoDBand transportedMongoDBinto the Data Warehouse.
- Integrated state-of-the-art Big Data technologies into the overall architecture
- Created reports and dashboards using structured and unstructured data.
- Provide analysis and development support for ETL and data integration initiatives
- Provide the technical and overall development
- Identify, document and communicate BI and ETL best practices and industry accepted development methodologies and techniques.
- Troubleshoot BI tool problems and provide technical support as needed. Perform other tasks as assigned.
- Worked on complete SDLC from Extraction, Transformation and Loading of data using Pentaho Kettle.
- Responsible for tuning ETL procedures and STAR Schema and Snow flake Schema to optimize load and query performance.
- Participated in meetings for reviewing ETL standards and best practices documents with COE Pentaho Team.
- Updated existing and created new documentation for ETL Mappings and migration.
- Worked very closely with Project Manager to understand the requirement of reporting solutions to be built.
- Gathered business requirement by understanding business Processes and needs.
- Installed and Configured Pentaho BI Suit along with Enterprise Repository in Pentaho BI server.
- Configured Pentaho BI Server for report deployment by creating database connections in Pentaho enterprise console for central usage by the reports deployed in the repository.
- Use Pentaho Design Studio for creating custom parameters as well as generating report.
- Used Pentaho Report designer to create various reports having drill down functionality by creating Groups in the reports and drill through functionality by creating sub-reports within the main reports.
- Tuned report queries running against Oracle database to get optimal performance.
- Working closely with DBA team to regularly monitor system for bottlenecks and implement appropriate solutions.
- Knowledge sharing about the Pentaho BI tool across all team members.
Environment: Pentaho BI Server, Pentaho Data Integration (PDI/Kettle), Pentaho Report Designer, Pentaho Dashboard Designer, Entiera, SQL Profiler.
Confidential, FL
ETL/Pentaho Developer
Responsibilities:
- Coded several database Stored Procedures, Functions, Packages and Triggers in PL/SQL, and maintained Integrity Constraints.
- Provide enhancements and maintenance support to current application.
- Designed pilot system using Pentaho Kettle for ETL enhancements and Pentaho BI Server for publishing the Pentaho Reports on user funds transfer measures.
- Used various types of inputs and outputs in Pentaho Kettle including Database Tables, MS Access, Text Files, Excel files and CSV files.
- Implemented miscellaneous transformations in Kettle Spoon Designer including Database Lookup, Database Join, Calculator, Generate Rows, Mapping Transformation, Filter Rows, Dimension Lookup/Update, Add Sequence, Add Constants, Row Normalizer and Demoralizer.
- Used SQL Queries in the Pentaho Interface.
- Created SSIS package to get data from different sources, consolidate and cleanse the data and merge it into one single source.
- Designed Data warehouse including star schema design, DW capacity planning, MySQL performance and tuning. Implemented Orders and Points DW using star schema, Orders and Points Business domain using Pentaho Meta Data. Created Stage based DW supported by that’s completely implemented in Pentaho Kettle.
- Participated in design ofStaging DatabasesandData Warehouse databaseusingStar Schema.
- Successfully converted all database code including stored procedures, functions and triggers written in PL/SQL into T-SQL to be created in new system running on SQL Server Database.
- Involved inperformance tuningofSQL queriesand stored procedures usingSQL ProfilerandIndex Tuning Wizard.
- Identified, tested, and resolveddatabase performance issues(monitoring and tuning) to ensure database optimization.
- Created several SSIS packages in Business Intelligence Development studio (BIDS) to extract data from OLTP systems and load into staging databases.
- Created triggers on master data tables in OLTP to keep track of insertion and updates.
- Create several user-defined functions to server miscellaneous purposes like getting a comma-separated list of values, performing aggregation etc.
- CreatedProfiling, Cleansing and auditingplans withSSISPackages.
- AppliedConfiguration, Logging, Error reportingto all packages to make package deployment easy and troubleshoot package on run time.
- Load data in Data ware House by usingSlowly Changing Dimension (SCD - Type 1, 2, 3)
- Useevent handling to send E-mail on eventlike on error.
- Created differentuser level groups, and assigned appropriatepermissionlevel to the database using Credentials tool.
- This made sure that only the right person with enough authorizations would be able to see their corresponding Information
- Use Data Viewersin SSIS Packages to check the flow of data during Execution of Packages
- Generated reports using SSRS that could be used to send information to different managers of Different Branch.
- Actively participated in all phases of system development life cycle (SDLC) starting from requirement gathering all the way up to deployment in production and system testing.
- Prepared user manual and technical support manual
- Created different type of reports includingCross-tab, Tabular, Charts, graphs, Sub reports, Drill-down reports with Cascading Parameter prompts.
- Performed SQL Server installation in Share-Point Integrated mode.
- Deployed SSRS reports on Report Server using Report Manager, as well on SharePoint Server.
- Generated the various kinds of reportsusing Graphs and Images
- Deployed SSRS reports using Report Manager and scheduled the reports to generate all daily, weekly, monthly and quarterly Reports including current status.
- Utilized Dynamic SQL in stored procedures to generate the query dynamically within the procedure using parameter values to make up the query.
Environment: Pentaho BI Server, Pentaho Data Integration (PDI/Kettle), Pentaho Mondrian OLAP Server, Pentaho Design Studio, Pentaho Report Designer, MS SQL Server,SQL Server Integration Services (SSIS), Oracle 10g,Enterprise ManagementStudio
Confidential, NJ
ETL Developer
Responsibilities:
- Developed DDL scripts for creation of tables, indexes, views and other Oracle Server objects.
- Coded several database Stored Procedures, Functions, Packages and Triggers in PL/SQL, and maintained Integrity Constraints.
- Provide enhancements and maintenance support to current application.
- Developed SSIS Packages to generate the reports in Excel sheets required by the managers for analysis.
- Created SSIS package to get data from different sources, consolidate and cleanse the data and merge it into one single source.
- Developed SSIS packages to transfer data from heterogeneous database (Oracle) & different files format (Text File, CSV, Spread Sheet) to SQL Server and vice versa.
- Used SQL Loader to import bulk data in Oracle tables from data files of different formats including fixed record, variable record and stream record format.
- Created and scheduled Various Daily running and Month end SQL Jobs, using SQL Server Agent to perform various ETL operations.
- Created new tables, wrote PL/SQL stored procedures and user defined functions for Application Developers.
- Created SQL scripts for tuning and scheduling.
- Created Triggers in PL/SQL to enforce data and referential integrity.
- Defined Check constraints, Business Rules, Indexes, and Views.
- Optimized long running SQL queries and PL/SQL stored procedures.
- Performed development support, documented reviews and test plans.
- Created and maintained Indexes for various fast and efficient reporting processes.
- Implemented package configurations in SSIS packages allowing transferring packages from one Environment to other.
- Deployed SSIS packages on production servers and scheduled those to run on routine basis and monitored the error log for any errors.
- Created users and roles in Oracle as well as Windows Server and maintained proper security procedures by assigning appropriate permission levels to the users.
- Worked with the Planning team to forecast the business requirement
Environment: PL/SQL, SQL Loader, Toad, Oracle SQL Developer, SSIS, Unix, Windows Server, SQL Server, Management Studio, Visio, MS Excel, VB.Net, ASP.Net
Confidential, NJ
ETL Developer
Responsibilities:
- Monitor all aspects of organizational business engagements, both internal as well external, to ensure that the interfaces are developed and delivered to meet ETL standards and best practices
- Loaded monthly, weekly, daily data, to track issues and resolve them based on the priority.
- Collaborated with Database Administrators, Developers, and Analysts on all aspects of data management.
- Used error handling strategy for trapping errors by defining error handling in all crucial steps of ETL transformations and sending errors to an error table.
- Monitor and troubleshoot batches and sessions for weekly and Monthly extracts from various data sources across all platforms to the target database.
- Involved in Performance tuning at source, target, mappings, sessions, and system levels.
- Tested the data and data integrity among various sources and targets. Associated with Production support team in various performances related issues.
- Developed UNIX shell scripts to move source files to archive directory.
- Designed the reports with multi level of groupings (hierarchies)
- A great deal of my assignment was in creating standard templates while designing reports to work with conditional formatting, sorting and running totals, converting old reports from MS-Access and Excel to Pentaho reports (prpt files), and creating functionality for a smooth export into various formats like EXCEL, PDF, HTML, and RTF per user requirements
- Spent time working with business users on getting specifications for reports and build prototypes developed for implementation on Pentaho Enterprise Server for User Acceptance Testing(UAT). This would involve constant analysis, regression testing, and iterative solutions before published it on Pentaho Enterprise Server production environment. In some cases, the responsibility of assuring scheduled reports got to intended recipients’ email for quarterly ends.
- Helped tune the database to resolve performance issues and ensured high performance through periodic performance evaluation and improvements.
- Involved in Unit, Integration, system, and performance testing levels.
- Interacted with executives to learn the business objectives and propose creative solutions to meet those objectives
- Provided Recommendations for cost mitigation solutions brought to the table with design approaches with the software development team to effectively represent the required data for analysis
- Documented for ERDs, Pentaho Report Templates and Pentaho Schema and Cube Designs.
Environment: SQL Server, Oracle, Pentaho BI Suite (Kettle, Report Designer, Design Studio), SQL Management Studio, Windows Server
Confidential
ETL Developer
Responsibilities:
- Worked as a developer on databases like MS SQL Server, MS Access.
- Tested to optimize the Stored Procedures and Triggers to be used in production.
- Maintained the client relationship by communicating the daily statuses and weekly statuses of the project.
- Creating ETL Job flowdesign.
- Used ETL to load data into the Oracle warehouse.
- Worked on Data StageDesigner, Manager, Administrator and Director.
- Designed and implemented the Logical and Physical model of the database using Erwin.
- Planed, defined and designed data flow processes for data migration to the Data Warehouse using DTS.
- Created Database Objects - Tables, Indexes, Views, User defined functions, Cursors, Triggers, Stored Procedure, Constraints and Roles.
- Developed complex T-SQL code for the application.
- Worked in Enterprise Manager for job scheduling and batch queries.
- Installed and maintained MS SQL Server.
- Monitored performance and optimized SQL queries for maximum efficiency.
- Implemented fine tuning of database objects and server to ensure efficient data retrieval.
- Managed and monitored the use of disk space.
- Planned Backup strategy based on projects requirements.
- Worked with DTS packages and MS OLAP Services.
- Maintained the consistency of the client’s Database using DBCC.
- Documented ETL validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.