Description and Definition of HCM Data Loader
- 1. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka INTRODUCTION HCM Data Loader also referred to as HDL ( abbreviated form) is the next generation tool from Oracle for loading legacy HCM data into Fusion Applications. Starting with Release 9 July Monthly Update (Monthly Update Bundle 9.7). Oracle strongly recommends that all NEW Customers begin using HDL. Customers currently provisioned on Release 9 will require a configuration change. All environments provisioned in Release 10 will be defaulted to HDL. Existing Customers may continue using File Based Loader (FBL) but should begin evaluating HDL to plan a migration in the future, where applicable. There are a few scenarios where HDL may not be recommended, and an exception may be considered, for both, existing and new Customers. SITUATIONS WHERE HCM DATA LOADER MAY NOT BE RECOMMENDED a) An existing customer using File-Based Loader who purchases additional test environment that is created on R10. b) The customer must log an SR to change the default setting of Full to Limited to match other environments. c) Customers with PeopleSoft Integration. d) Customers with Taleo Integration via Taleo Connect Client (TCC) and File-Based Loader. MIGRATING FROM FILE-BASED LOADER TO HCM DATA LOADER 1. Is File-Based Loader used for migration only? If so, once migration is complete, then HCM Data Loader could be considered. 2. Is File-Based Loader used for ongoing integration? If so, then there will need to be rework of processes and a cutover decision. 3. How are File-Based Loader data files generated? Whatever method is used for generating the File-Based Loader data files will need to be reworked to generate the correct HCM Data Loader format.
- 2. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka 4. The complexity of the integration will need to be taken into account to determine who does the rework of the extract mechanism. 5. Are you loading objects outside of File-Based Loader and HCM Spreadsheet Data Loader (via SR requested scripts)? If this is causing delays and issues related to lack of automation, then HCM Data Loader should be considered. 6. Are there users who load data using HCM Spreadsheet Data Loader? A move to HCM Data Loader in R10 would disable this 7. Functionality, so it would probably be worth waiting for spreadsheet support. HCM Data Loader migration should be treated as an implementation with a proper project plan. File-Based Loader GUID values can continue to be used with HCM Data Loader. A process can be run to convert the File-Based Loader GUID into a source key that HCM Data Loader can recognize. 8. HR spreadsheet loaders in the Data Exchange work area will not be available to use in conjunction with HCM Data Loader 9. HCM Data Loader and File-Based Loader cannot be used at the same time for objects supported by both. 10. Payroll batch loader is still required for some payroll object loads. 11 Environment refresh will overwrite HCM Data Loader settings if the source environment uses File-Based Loader. You will have to follow the process again to enable HCM Data Loader and convert File-Based Loader GUIDs and source keys. 12. Once HCM Data Loader is enabled in a test environment, no additional File-Based Loader load testing will be possible NEW IMPLEMENTATION CONSIDERATIONS 1) Customers who have recently started implementing and have not yet gone live should consider switching to HCM Data Loader if their timelines can accommodate it. 2) This will mitigate the need for conversion to HCM Data Loader later in the project lifecycle. Project plans should be reviewed to incorporate the migration to HCM Data Loader, taking into account: 3) Training on the new tool 4) Rework of the extract mechanism to get data in the HCM Data Loader format 5) The need to test the migration and integration processes using HCM Data Loader instead of File Based Loader 6) The need to fit in with major implementation milestones CONSIDERATIONS FOR EXISTING CUSTOMERS 1. Existing live customers already using File-Based Loader and HCM Spreadsheet Data Loader should defer the switch to HCM Data Loader.
- 3. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka 2. Customers who are not yet live should evaluate whether to rework their implementation to use HCM Data Loader or continue using File-Based Loader and HCM Spreadsheet Data Loader. 3. The main work involved in using File-Based Loader and HCM Data Loader is the extract of the data from a source system to the correct format ready for loading. Since this is not part of Oracle Fusion, Oracle does not provide a conversion process from File-Based Loader to HCM Data Loader. 4. Oracle does provide the migration of File-Based Loader GUID values to the HCM Data Loader equivalent, which are referred to as source keys. 5. Customers using Oracle Fusion Taleo Recruitment Out of the Box (OOTB) V1 Integration are not impacted. 6. If you are using Taleo Connect Client and File-Based Loader or a hybrid with OOTB to integrate with Fusion, you will need to perform an evaluation and follow the steps to migrate to HCM Data Loader HCM DATA LOADER COMPATIBILITY WITH FILE BASED LOADER HCM Data Loader and File-Based Loader cannot be used at the same time for objects supported by both. Either of them should be picked for conversion. The setting of the HCM Data Loader Scope parameter on the Configure HCM Data Loader page determines whether HCM Data Loader or File-Based Loader is used and controls the behavior of the loading tools. The default value of this parameter is Limited for existing customers. If you attempt to load data for a business object not supported in the Limited mode, your whole data set will fail. Limited mode Only business objects not supported by HCM File-Based Loader can be loaded using HCM Data Loader. All objects that can use File-Based Loader must use File-Based Loader. Any objects that are not available via File-Based Loader should use HCM Data Loader. Full mode HCM Data Loader is used for bulk-loading data into all supported business objects. HCM File Based Loader and HCM Spreadsheet Data Loader are disabled. Important Note: You can switch from Limited mode to Full mode, but you cannot switch from Full mode to Limited mode. This is a one-time switch from File-Based Loader to HCM Data Loader. Once you migrate to HCM Data Loader, HCM Spreadsheet Data Loader is also disabled because it relies on the File-Based Loader engine to load data to Oracle HCM Cloud. This restriction applies only to the spreadsheet loading that is launched from the Data Exchange work area. Other spreadsheet data loaders are not impacted by the uptake of HCM Data Loader.
- 4. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka IMPACT OF UPGRADE TO RELEASE 10 HCM Data Loader will be Generally Available in R10 ( also in Release 9 Patch Bundle 7 and above ) but there is no immediate requirement to migrate to HCM Data Loader. HCM Data Loader and File-Based Loader cannot be used at the same time for objects supported by both. On upgrade to Release 10 you will see the HCM Data Loader options available in the application but you should not use HCM Data Loader if you are an existing File-Based Loader customer until you have completed an evaluation of HCM Data Loader. Important Note: There are differences in file format and key structures. Once the switch to HCM Data Loader has occurred, you will no longer have access to File-Based Loader or HCM Spreadsheet Data Loader. If you have a requirement to load documents of record or areas of responsibility, then you can use HCM Data Loader in Limited mode with no impact on File-Based Loader or HCM Spreadsheet Data Loader, since these objects are not currently supported by File-Based Loader ENVIRONMENT MANAGEMENT CONSIDERATIONS If you are live with File-Based Loader and testing HCM Data Loader in a nonproduction environment, then you should plan your environment refresh (P2T) requests carefully. When you request an environment refresh, the HCM Data Loader settings will be overwritten, and the environment will revert to the default Limited mode. You will need to go through the same steps as before to switch back to HCM Data Loader. That is, you must convert File-Based Loader GUIDs to HCM Data Loader source keys and switch HCM Data Loader Scope to Full. During the HCM Data Loader migration validation and testing, important testing considerations must be included in your planning.
- 5. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka HCM Data Loader in Full mode is not compatible with File-Based Loader; therefore, it is not possible to have an environment with both HCM Data Loader and File-Based Loader at the same time. This will impact your ability to test File-Based Loader transactions in your nonproduction environment while you are in the process of validating HCM Data Loader. Important Note: You will need to ensure that the HCM Data Loader enabled environment is not required for any File-Based Loader testing prior to setting the HCM Data Loader Scope to Full. MIGRATION STEPS FOR MOVING FROM FILE BASED LOADER TO HCM DATA LOADER It is not possible to move to HCM Data Loader for individual core objects on an incremental basis. It is a one-time migration and requires careful planning and preparation to ensure a smooth transition. CHOICE OF KEYS One of the most important decisions when considering the upgrade from File-Based Loader to HCM Data Loader is whether to continue to use the same key mechanism as is used in File-Based Loader (GUIDs) or whether to take advantage of the user key support that is available in HCM Data Loader. User keys allow objects to be identified in HCM Data Loader using their natural key; for example, Job Code, Person Number, and so on. File-Based Loader GUIDs have an equivalent in HCM Data Loader known as source keys. These are values that are defined in the source system and stored alongside the Oracle Fusion surrogate keys when objects are created in Oracle HCM Cloud. Source keys can be used to reference objects when loading related data or to identify specific objects when performing updates or deletes. Within HCM Data Loader, each object can use different types of keys, so a decision needs to be made on an object-by-object basis to determine whether a user key or a source key will be used. CONVERSION OF GUIDS In order to facilitate the upgrade from File-Based Loader to HCM Data Loader, a process is provided to migrate the File-Based Loader GUIDs to HCM Data Loader source system IDs. Regardless of whether user keys or source keys will be used, it is recommended that this process be run as the first step
- 6. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka TEMPLATE GENERATION Before reworking the export processes, you can download a template for each business object supported by HCM Data Loader. These templates take into account any flex-field structures that are already in place. By using the templates, you can accurately outline the shape of the data that needs to be generated by the reworked export processes. REWORK OF EXPORT PROCESSES The main task required for migration to HCM Data Loader is the rework of the export process that generates the data for loading to Oracle HCM Cloud. This process needs to take into account the correct attributes for the HCM Data Loader objects as well as preparing the files in the format expected by HCM Data Loader. The attached spreadsheet provides a mapping between the HCM Data Loader data file name, file discriminator, and attribute name to the HCM File-Based Loader data file and attribute name. HCM Data Loader only supports files loaded via Oracle Web-Center Content. If customers are currently using SFTP, then the processes will need to be changed. Similar to File-Based Loader, HCM Data Loader has a web service that can be used to invoke the HCM Data Loader processing. HCM_Data_Loader_ to_File-Based_Loader_Field_Mapping.xlsx Sample Screenshot (Mapping Sheet)
- 7. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka OFFLINE VERIFICATION USING HDLDI The offline Data File Validator Tool (HDLdi) and used in the extract process to ensure that the data files being prepared are valid in terms of the data format. It also checks any business rules that apply to the data contained in the data file where other Oracle HCM Cloud data is not required as part of the validation.
- 8. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka HCM DATA LOADER PROCESS FLOW DIAGRAM
- 9. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka HDL (HCM DATA LOADER) VS FBL (FILE BASED LOADER) COMPARATIVE ANALYSIS (TOP 10 POINTS) HCM DATA LOADER ( HDL ) FILE BASED LOADER ( FBL ) HAS NEW FEATURES CUSTOMERS ALREADY ACCUSTOMED TO USING FBL SINGLE WORKER FILE MULTIPLE FILES TO LOAD WORKER DETAILS ALLOWS BULK AND DELTA LOAD SPECIAL CONSIDERATIONS REQUIRED FOR DELTA LOAD ERROR HANDLING MECHANISM IS EASY ERROR HANDLING TAKES LOT OF TIME AND EFFORT ALLOWS DATE EFFECTIVE HISTORICAL DATA LOAD. NEED TO PASS ONLY THE (N + 1 )TH RECORD ALLOWS DATE EFFECTIVE HISTORY LOAD. IN CASE YOU NEED TO LOAD (N + 1)TH RECORD ALL RECORDS STARTING FROM 1 TO N ALSO NEEDS TO BE PASSED ORACLE RECOMMENDS FOR ALL NEW IMPLEMENTATIONS ONLY RECOMMENDED FOR EXISTING CUSTOMERS ENSURES EITHER COMPLETE DETAILS GET LOADED OR NONE. NO PARTIAL CONVERSION ALLOWED. ALL OR NONE APPROACH CUSTOMERS ALREADY ACCUSTOMED TO USING FBL. PARTIAL LOAD HAPPENS CAUSING SYNC ISSUES. MAJOR SETBACK FOR ALL IMPLEMENTATIONS USES SOURCE SYSTEM KEYS APPROACH. USER FRIENDLY PRIMARY KEYS FOLLOWS GUID APPROACH. PRIMARY KEYS ARE NOT USER FRIENDLY HDL TEMPLATES ( DATA FILE FORMAT) REQUIRED FOR CONVERSION CAN BE DOWNLOADED FROM THE APPLICATION INSTANCE ( COMMONLY REFERRED TO AS POD) ITSELF. NO ADDITIONAL SR (SERVICE REQUESTS) NEEDS TO BE RAISED FBL TEMPLATES ARE MADE AVAILABLE ON REQUEST ( VIA SR) TODAY OR TOMORROW YOU HAVE TO ACCEPT USING HDL. YOU MAY DELAY USING IT BUT CANNOT AVOID IT. FBL IS AGE OLD TECHNOLOGY NOW. YOU CAN USE IT FOR NOW BUT IT IS ON THE VERGE OF EXTINCTION.
- 10. DESCRIPTION AND DEFINITION OF HCM DATA LOADER Author: Ashish Harbhajanka SAMPLE HDL FILES Worker.dat Worker.dat