Data Match Merging in SAS

SASTechies [email_address] http://www.sastechies.com

data finance.duejan; set finance.loans; Interest=amount*(rate/12); run; SAS Data Set Finance.Loans 11/13/09 SAS Techies 2009 Account Amount Rate Months Payment 101-1092 22000 0.1000 60 467.43 101-1731 114000 0.0950 360 958.57 101-1289 10000 0.1050 36 325.02 101-3144 3500 0.1050 12 308.52

Each time the SET statement is executed, SAS reads one observation into the program data vector. SET reads all variables and all observations from the input data sets unless you tell SAS to do otherwise. A SET statement can contain multiple data sets; a DATA step can contain multiple SET statements. SET < SAS-data-set(s) <( data-set-options(s) )>> < options >; 11/13/09 SAS Techies 2009

SAS Techies 2009 data lab23.drug1h; set research.cltrials; if placebo='YES' ; run; data lab23.drug1h; set research.cltrials; Where placebo='YES' ; run; data lab23.drug1h; set research.cltrials ( Where=( placebo='YES‘)) ; run; data lab23.drug1h; set A C; run; 11/13/09

data lab23.drug1h(drop=placebo); set research.cltrials (drop=triglycerides uricacid) ; if placebo='YES'; run; data lab23.drug1h(drop=placebo) ; set research.cltrials (drop=triglycerides uricacid placebo); if placebo='YES'; run; If you don't process certain variables and you don't want them to appear in the new data set, specify them in the DROP= option in the SET statement. If you do need to process a variable in the original data set (in a subsetting IF statement, for example), you must specify the variable in the DROP= option in the DATA statement. Otherwise, the statement that is using the variable for processing causes an error. SAS Techies 2009 11/13/09

SAS Techies 2009 Proc sort data=a;by num; Proc sort data=b;by num; data sharad; merge a b; by num; run; data sharad; set a b; run; 11/13/09

The DATA step provides a large number of other programming features for manipulating data sets. For example, you can use IF-THEN/ELSE logic to control processing based on one or more conditions specify additional data set options perform calculations create new variables process variables in arrays use SAS functions use special variables such as FIRST. and LAST. to control processing. You can also combine SAS data sets in other ways, including match merging, interleaving, one-to-one merging, and updating. SAS Techies 2009 11/13/09

DATA output-SAS-data-set ; MERGE SAS-data-set-1 SAS-data-set-2 ; BY variable(s) ; RUN; produces an output data set that contains values from all observations in all input data sets . In DATA step match-merging, all data sets to be merged must be sorted or indexed by the values of BY variable The common variable must have the same type and length in all data sets to be merged. SAS Techies 2009 11/13/09 You can specify any number of input data sets in the MERGE statement.

PROC SORT < DATA= SAS-data-set > < OUT= SAS-data-set > <options> ; BY variable(s) ; RUN; Interesting options -nodupkey -noduprecs -where statement Note: If you don't use the OUT= option, PROC SORT permanently sorts the data set specified in the DATA= option SAS Techies 2009 11/13/09 Obscc ID Age Sex Date 1 A001 21 m 05/22/75 2 A001 21 m 05/22/75 3 A003 24 f 08/17/72 4 A004 . 03/27/69 5 A005 44 f 02/24/52 6 A007 39 m 11/11/57 Obs ID Age Sex Date 1 A001 21 m 05/22/75 2 A001 32 m 06/15/63 3 A003 24 f 08/17/72 4 A004 . 03/27/69 5 A005 44 f 02/24/52 6 A007 39 m 11/11/57

data clinic.combined; merge clinic.demog (rename=(date=BirthDate)) clinic.visit (rename=(date=VisitDate)) ; by id; If Birthdate = ’05Mar2005’d ; Rename birthdate=somedate; run; Note: when you rename you should be using the new name in that datastep. (RENAME=( old-variable-name = new-variable-name )) where the RENAME= option, in parentheses, follows the name of each data set that contains one or more variables to be renamed old-variable-name names the variable to be renamed new-variable-name specifies the new name for the variable. You can rename any number of variables in each occurrence of the RENAME= option. SAS Techies 2009 11/13/09

data combined; merge clients (in=A) Amounts (in=B) ; by Name; If A and B; run; Note:If the expression is true for the observation, the current observation is written to the output data set. (IN= variable ) where the IN= option, in parentheses, follows the data set name variable names the variable to be created. the IN= data set option to create and name a variable that indicates whether the data set contributed data to the current observation the subsetting IF statement to check the IN= values and output only those observations that appear in the data sets for which IN= is specified. SAS Techies 2009 11/13/09

The Compilation Phase: Setting Up the New Data Set To prepare to merge data sets, SAS software reads the descriptor portions of data sets listed in the MERGE statement reads the remainder of the DATA step program creates the program data vector (PDV) assigns a tracking pointer to each data set listed in the MERGE statement. If variables with the same name appear in more than one data set, the variable from the first data set that contains the variable (in the order listed in the MERGE statement) determines the length of the variable. SAS Techies 2009 11/13/09

The Execution Phase: After compiling the DATA step, SAS software sequentially match-merges observations by moving the pointers down each observation of each data set and checking to see whether the BY values match . If Yes , the observations are written to the PDV in the order the data sets appear in the MERGE statement. (Remember that values of any like-named variable are overwritten by values of the like-named variable in subsequent data sets.) SAS software writes the combined observation to the new data set and retains the values in the PDV until the BY value changes in all the data sets. SAS Techies 2009 11/13/09

If No , SAS software determines which of the values comes first and writes the observation containing this value to the PDV. Then the observation is written to the new data set. SAS Techies 2009 11/13/09

When the BY value changes in all the input data sets, the PDV is initialized to missing. The DATA step merge continues to process every observation in each data set until it exhausts all observations in all data sets. SAS Techies 2009 11/13/09

Handling Unmatched Observations and Missing Values By default, all observations written to the PDV, including observations with missing data and no matching BY values, are written to the output data set. (If you specify a subsetting IF statement to select observations, only those that meet the IF condition are written.) If an observation contains missing values for a variable , the observation in the output data set contains the missing values as well. Observations with missing values for the BY variable appear at the top of the output data set. If an input data set doesn't have any observations for a given value of the common variable, the observation in the output data set contains missing values for the variables unique to that input data set. SAS Techies 2009 11/13/09

The DATA step provides a large number of other programming features for manipulating data sets during match-merging. For example, you can use IF-THEN/ELSE logic to control processing based on one or more conditions specify additional data set options perform calculations create new variables process variables in arrays use SAS functions use special variables such as FIRST. and LAST. to control processing. SAS Techies 2009 11/13/09

options pageno=1 nodate linesize=80 pagesize=60; data testfile; Set some; by Drug Rx; If first.Drug then TRx=0; TRx+Rx; If last.Drug then output; Run; Drug Rx A 10 Output Testfile A 11 Drug TRx B 11 A 21 B 12 B 23 When an observation is the first in a BY group, SAS sets the value of FIRST. variable to 1 for the variable whose value changed, as well as for all of the variables that follow in the BY statement. For all other observations in the BY group, the value of FIRST. variable is 0. Likewise, if the observation is the last in a BY group, SAS sets the value of LAST. variable to 1 for the variable whose value changes on the next observation, as well as for all of the variables that follow in the BY statement. For all other observations in the BY group, the value of LAST. variable is 0. For the last observation in a data set, the value of all LAST. variable variables are set to 1. SAS Techies 2009 11/13/09 FIRST.Drug FIRST.Rx LAST.Drug LAST.Rx 1 1 0 1 0 1 1 1 1 1 0 1 0 1 1 1

System options apply to the datasets, output for the entire session. Can be overridden by Dataset options Can be declared anywhere except within Datalines/cards statements Ex: options compress=yes, obs=max Ex: Options compress=no obs=max; data new; Set cool (obs=10,compress=yes); Run; Dataset options applies to that particular dataset only. CANNOT be overridden by system options. Can be declared only with the dataset options Ex: data new; Set cool (obs=10,compress=yes); Run; SAS Techies 2009 11/13/09

GOTO label; The GOTO statement tells SAS to jump immediately to the statement label that is indicated in the GOTO statement and to continue executing statements from that point until a RETURN statement is executed. A RETURN statement after a GO TO statement returns execution to the beginning of the next DATA step iteration LINK label ; The LINK statement tells SAS to jump immediately to the statement label that is indicated in the LINK statement and to continue executing statements from that point until a RETURN statement is executed. The RETURN statement sends program control to the statement immediately following the LINK statement. SAS Techies 2009 11/13/09

SAS Techies 2009 LINK Statement data hydro; input type $ depth station $; if type ='aluv' then link calcu; date=today(); return; calcu: if station='site_1' then elevatn=6650-depth; else if station='site_2' then elevatn=5500-depth; return; datalines; aluv 523 site_1 uppa 234 site_2 aluv 666 site_2 ... more data lines ... ; Goto Statement data info; input x; if 1<=x<=5 then goto add; put x=; return; add: sumx+x; return; datalines; 7 4 323 ; Run; 11/13/09

Data Match Merging in SAS

More Related Content

What's hot (20)

Viewers also liked (16)

Similar to Data Match Merging in SAS (20)

Recently uploaded (20)

Data Match Merging in SAS

Editor's Notes