Pilot study

July 30, 2017July 30, 2017
RESEARCH – PILOT
STUDY

July 30, 2017July 30, 2017
Definition of research :Definition of research :
Systematic enquiry thatSystematic enquiry that
uses orderly , disciplineduses orderly , disciplined
methods to answermethods to answer
questions or solve problemsquestions or solve problems
..

July 30, 2017July 30, 2017
ResearchResearch
problem :problem :
A situation involving anA situation involving an
enigmatic , perplexing orenigmatic , perplexing or
conflictful condition that canconflictful condition that can
be investigated throughbe investigated through
disciplined inquiry .disciplined inquiry .

July 30, 2017July 30, 2017
Steps in the research processSteps in the research process
::
Phase I :Phase I : Conceptual phaseConceptual phase
Phase II :Phase II : The design andThe design and
planningplanning
phasephase ( Pilot( Pilot
study ) .study ) .
Phase III :Phase III : The emperical phase .The emperical phase .

July 30, 2017July 30, 2017
Three methods to minimizeThree methods to minimize
these problems :these problems :
* Pre testing* Pre testing
* Conducting a pilot study .* Conducting a pilot study .
** Adding manipulationAdding manipulation
checkschecks ..

July 30, 2017July 30, 2017
Pre testing :Pre testing :
It is the process ofIt is the process of
measuring the effectivenessmeasuring the effectiveness
of the instrument developedof the instrument developed
for the major study or testingfor the major study or testing
the hypotheses .the hypotheses .

July 30, 2017July 30, 2017
Pilot study :Pilot study :
-- It is the preliminary small -It is the preliminary small -
scale trial run of the researchscale trial run of the research
study .study . (Treece & Treece)(Treece & Treece)
- It is a small - scale version or- It is a small - scale version or
trial run done in preparation fortrial run done in preparation for
a major study.a major study. (Polit & Hunglar )(Polit & Hunglar )

July 30, 2017July 30, 2017
Manipulation Checks :Manipulation Checks :
It is simply testing whetherIt is simply testing whether
or not your independentor not your independent
variables had the intendedvariables had the intended
effects on your participants .effects on your participants .

July 30, 2017July 30, 2017
Pretesting the instrument :Pretesting the instrument :
(Purpose)(Purpose)
 Trial test of the instrumentTrial test of the instrument
developed for testing thedeveloped for testing the
hypotheses .hypotheses .
 Time for checking the reliabilityTime for checking the reliability
& validity of the instrument.& validity of the instrument.
 Pre - test is a check on thePre - test is a check on the
instrument to evaluate suchinstrument to evaluate such
factors as it’s length , it’sfactors as it’s length , it’s
wording .wording .

July 30, 2017July 30, 2017
Reveals problems relating toReveals problems relating to
answering, completing andanswering, completing and
returning the instrument .returning the instrument .
Helps in tabulating the data .Helps in tabulating the data .
Also points out weaknesses inAlso points out weaknesses in
administration , organizationadministration , organization
and distribution of theand distribution of the
instrumentinstrument

July 30, 2017July 30, 2017
Methods of pre testing :Methods of pre testing :
** InterviewingInterviewing
GG ives opinions of peopleives opinions of people
differing in education ,differing in education ,
temperament and view points totemperament and view points to
see if they understand thesee if they understand the
questions and are able to givequestions and are able to give
complete and pertinent answerscomplete and pertinent answers
..

July 30, 2017July 30, 2017
During pre test researcher mustDuring pre test researcher must
keep in mind purpose of the study ,keep in mind purpose of the study ,
at the same time be aware of theat the same time be aware of the
aim and intent of each question :aim and intent of each question :
Investigator must be alert to everyInvestigator must be alert to every
question , comment & non verbalquestion , comment & non verbal
cue of the respondent & shouldcue of the respondent & should
carefully record them( alternativecarefully record them( alternative
questions should replace (them)questions should replace (them)
those that are not clear) .those that are not clear) .

July 30, 2017July 30, 2017
 Ask the respondents if they areAsk the respondents if they are
stuck, if they are not able tostuck, if they are not able to
understand the questions .understand the questions .
They should note questions whichThey should note questions which
needed moreneeded more
information/clarification .information/clarification .
 If sufficient space was allowed forIf sufficient space was allowed for
recording answers & if therecording answers & if the
instrument was too long (time toinstrument was too long (time to
administer )administer )

July 30, 2017July 30, 2017
 Interviewer should record theirInterviewer should record their
own observations, criticism,own observations, criticism,
difficulty in location of respondents,difficulty in location of respondents,
questions causing embarrassmentquestions causing embarrassment
and resistance ,problems ofand resistance ,problems of
maintaining rapport andmaintaining rapport and
respondents who are bored /respondents who are bored /
impatient .impatient .
 Is the question understood &Is the question understood &
answered in a matter wanted to .answered in a matter wanted to .

July 30, 2017July 30, 2017
 It also answers questions as :It also answers questions as :
• Is proper place available for theIs proper place available for the
interviewer ?interviewer ?
• How much time is needed to ask all theHow much time is needed to ask all the
questions ?questions ? ( get informed consent for( get informed consent for
lengthy ones ) .lengthy ones ) .
• Is more than one interviewer needed ?Is more than one interviewer needed ?
• Are they properly trained ?Are they properly trained ?
• do the subjects understand thedo the subjects understand the
wordingswordings
of the questions or if they misinterpretof the questions or if they misinterpret
questions ?questions ?

July 30, 2017July 30, 2017
• do the participants find any part of thedo the participants find any part of the
questionnaire objectionable or offensivequestionnaire objectionable or offensive
??
• is the sequencing of instruments withinis the sequencing of instruments within
the data collection package is smooththe data collection package is smooth
and effective .and effective .
• does the instrument yeild data withdoes the instrument yeild data with
sufficient variability .sufficient variability . ( For most( For most
research questions the instrumentsresearch questions the instruments
should ideally discriminate amongshould ideally discriminate among
participants with different levels of anparticipants with different levels of an
attribute ) –attribute ) – women experience greaterwomen experience greater
depression than mendepression than men – an instrument to– an instrument to

July 30, 2017July 30, 2017
During the pre test the instrument &During the pre test the instrument &
scales are likewise tested toscales are likewise tested to
determine theirdetermine their Reliability &Reliability &
ValidityValidity
Reliability :Reliability : Refers to the degree ofRefers to the degree of
consistency (or) accuracy with whichconsistency (or) accuracy with which
the instrument ( used under similarthe instrument ( used under similar
conditions ) measures the attributeconditions ) measures the attribute
under investigation .under investigation .
Validity :Validity : Refers to the degree ofRefers to the degree of
consistency (or) accuracy with whichconsistency (or) accuracy with which
the instrument measures what it isthe instrument measures what it is

July 30, 2017July 30, 2017
Process of pre testing an instrument :Process of pre testing an instrument :
Validity ?Validity ? ValidValid!!
Reliability ?Reliability ?
ReliableReliable!!
Instrument
Untested
Tried on
Subjects
Applied in
Actual
situation
Revised perhaps
More than one
Time
Instrument
Valid

July 30, 2017July 30, 2017
THE PILOT STUDY :THE PILOT STUDY :
A small preliminaryA small preliminary
investigation of the sameinvestigation of the same
general character as thegeneral character as the
major study .major study .

July 30, 2017July 30, 2017
designed to acquaint thedesigned to acquaint the
researcher with the problems to beresearcher with the problems to be
corrected in preparation for thecorrected in preparation for the
larger research project .larger research project .
 it also provides the researcherit also provides the researcher
with an opportunity to try out thewith an opportunity to try out the
procedures for collecting data .procedures for collecting data .
 during pilot study the instrumentsduring pilot study the instruments
is going through a pretest althoughis going through a pretest although
the instrument content is expectedthe instrument content is expected
to be in final form by this stage .to be in final form by this stage .

July 30, 2017July 30, 2017
What should be ready by the timeWhat should be ready by the time
you come to the pilot studyyou come to the pilot study
stage you should have:stage you should have:
 Conceptualized the problemConceptualized the problem
 Thought through the implicationsThought through the implications
 Completed the literary searchCompleted the literary search
 Stated the hypotheses / QuestionStated the hypotheses / Question
 Determined the sampleDetermined the sample
 Developed the instrumentDeveloped the instrument

July 30, 2017July 30, 2017
 Determined the sampleDetermined the sample
 Developed the instrumentDeveloped the instrument
 Worked out the research designWorked out the research design
 Decided on the samplingDecided on the sampling
techniquetechnique
 Decide on the method of testingDecide on the method of testing
thethe
hypotheseshypotheses
 Planned on testing & analyzing hisPlanned on testing & analyzing his
datadata

July 30, 2017July 30, 2017
The purpose of pilot study isThe purpose of pilot study is
mainly two fold :mainly two fold :
 To make improvements in theTo make improvements in the
research project .research project .
 To detect problems that mustTo detect problems that must
be solved before the majorbe solved before the major
study is attempted .study is attempted .

July 30, 2017July 30, 2017
The purposes explained are …….The purposes explained are …….
 Determine if the proposed study isDetermine if the proposed study is
feasible or not .feasible or not .
 Develop & refine the instrument .Develop & refine the instrument .
 Develop a protocol for theDevelop a protocol for the
implementation of the treatment .implementation of the treatment .
 Identify problems with the design .Identify problems with the design .
 Determine if the sample isDetermine if the sample is
representative of the population orrepresentative of the population or
whether sampling technique iswhether sampling technique is
effective .effective .

July 30, 2017July 30, 2017

Examine the reliability & validity ofExamine the reliability & validity of
the research instrumentthe research instrument ..
 Reliability is concerned withReliability is concerned with
consistency , accuracy , precision ,consistency , accuracy , precision ,
stability , equivalence , homogenecity ;stability , equivalence , homogenecity ;
 Validity is concerned with content ,Validity is concerned with content ,
criterion & construct ;criterion & construct ;
 Refine the data collection &Refine the data collection &
analysis plananalysis plan
 Give the researcher experienceGive the researcher experience
with subjects , setting ,with subjects , setting ,
methodology & methods ofmethodology & methods of

July 30, 2017July 30, 2017
Implement analysis techniques .Implement analysis techniques .
 Brings out the inadequacies in theBrings out the inadequacies in the
drafted questionnaire .drafted questionnaire .
 Tests interviewers stamina to workTests interviewers stamina to work
under conditions of personalunder conditions of personal
discomfort , stress & fatigue .discomfort , stress & fatigue .
 It helps in identifying the need forIt helps in identifying the need for
different vehicles , kinds ofdifferent vehicles , kinds of
equipments which are neededequipments which are needed
during the project .

July 30, 2017July 30, 2017
It provides data for makingIt provides data for making
estimates of time & costs forestimates of time & costs for
completing various phases of thecompleting various phases of the
project .project . ((Whom to approachWhom to approach in thein the
town , village …)town , village …)
 What they should or should notWhat they should or should not
say .say .
 Disputes to be handled .Disputes to be handled .
 How interviewer should dress .How interviewer should dress .

July 30, 2017July 30, 2017
 What kind of behavior to avoid .What kind of behavior to avoid .
In short it is a preview of :In short it is a preview of :
 How will the interviewerHow will the interviewer
perform .perform .
 How the respondants willHow the respondants will
behave .behave .
 Procedures in the workProcedures in the work
placeplace

July 30, 2017July 30, 2017
Advantages of pilot study :Advantages of pilot study :
 Saves tremendous amount ofSaves tremendous amount of
time & money .time & money .
 Helps clarify instructions .Helps clarify instructions .
 Determine appropriate levels ofDetermine appropriate levels of
independent variables .independent variables .
 Help make fewer mistakes in theHelp make fewer mistakes in the
real study .real study .

July 30, 2017July 30, 2017
Some negative aspects ofSome negative aspects of
pilot studypilot study ::
 Requires time to conduct .Requires time to conduct .
 Entails some expenditure ofEntails some expenditure of
supplies .supplies .
 When animals are usedWhen animals are used
answerable to the concernedanswerable to the concerned
authorities .authorities .

July 30, 2017July 30, 2017
Pilot study size :Pilot study size :
 If sample size is 100 then 10 mustIf sample size is 100 then 10 must
be taken for pilot study (1/10be taken for pilot study (1/10thth
) .) .
 Time and cost may limit the pilotTime and cost may limit the pilot
study size .study size .
 Size is determined by the amountSize is determined by the amount
of time available .of time available .
 If the number of subjects orIf the number of subjects or
objects is sufficient to test theobjects is sufficient to test the
usefulness , then the size of theusefulness , then the size of the
pilot study is adequate .pilot study is adequate .

July 30, 2017July 30, 2017
Principles in the pilot study :Principles in the pilot study :
Principle of confidentialityPrinciple of confidentiality ::
Information discussed in the pilotInformation discussed in the pilot
study or pretest must be keptstudy or pretest must be kept
confidential .confidential .
 Principle of serendityPrinciple of serendity :: Pilot studyPilot study
results are always under the influenceresults are always under the influence
of serendity principle .of serendity principle .

July 30, 2017July 30, 2017
Not only does the pilot studyNot only does the pilot study
revealsreveals
weaknesses & flawsweaknesses & flaws ,,
but it can also open upbut it can also open up
unexpected and exciting newunexpected and exciting new
possibilities .possibilities .

July 30, 2017July 30, 2017
Why does pilot study fail to point upWhy does pilot study fail to point up
the flaws that are built into thethe flaws that are built into the
research design ?research design ?
1)1) It is an artificial situationIt is an artificial situation
2)2) The sample size is not largeThe sample size is not large
enough .(Few people will notenough .(Few people will not
encounter variety of behavior thatencounter variety of behavior that
are pertinent to the study )are pertinent to the study )
3)3) Larger numbers are needed toLarger numbers are needed to
make out flaws .make out flaws .

July 30, 2017July 30, 2017
Points to be kept in mind forPoints to be kept in mind for
pilot studypilot study ::
 It is important that all the steps in aIt is important that all the steps in a
pilot study be carried through ,pilot study be carried through ,
because it is only by completing thebecause it is only by completing the
full procedure that weaknesses can befull procedure that weaknesses can be
identified .identified .
 When examining the results of theWhen examining the results of the
pilot study researchers may discoverpilot study researchers may discover
that major changes must be made .that major changes must be made .

July 30, 2017July 30, 2017
 They may notice that some subjects doThey may notice that some subjects do
not meet the criteria foe the sample ,not meet the criteria foe the sample ,
the subjects do not understand thethe subjects do not understand the
items , a given question is not elicitingitems , a given question is not eliciting
the desired information (or) isthe desired information (or) is
irrelevant , important items have beenirrelevant , important items have been
omitted , (or) there is a gap betweenomitted , (or) there is a gap between
some of the questions .some of the questions .
 Pilot study participants should notPilot study participants should not
discuss the study with potential subjectsdiscuss the study with potential subjects
because this may bias the results of thebecause this may bias the results of the
study .study .

July 30, 2017July 30, 2017
 Every detail of the major study shouldEvery detail of the major study should
be undertaken in the pilot study frombe undertaken in the pilot study from
administration of the instrument ,administration of the instrument ,
tabulating the data , placing them intabulating the data , placing them in
tables analyzing the data b, noting anytables analyzing the data b, noting any
trends in the findings .trends in the findings .
 The researcher could decide if theThe researcher could decide if the
methodology meets the requirements formethodology meets the requirements for
testing the hypothesis .testing the hypothesis .
 Reformation of items may beReformation of items may be
necessary, additional questions may benecessary, additional questions may be
requiredrequired

July 30, 2017July 30, 2017
 The purpose of developing the tablesThe purpose of developing the tables
prior to collecting the data for the majorprior to collecting the data for the major
study is it gives the researcher an ideastudy is it gives the researcher an idea
of what the data will look like whenof what the data will look like when
collected .collected .
 As part of the research strategy theAs part of the research strategy the
investigator should have made ainvestigator should have made a
decision as to what type of statistics aredecision as to what type of statistics are
to be used ; A research design withoutto be used ; A research design without
tables is not a true research design .tables is not a true research design .

July 30, 2017July 30, 2017
Manipulation checks :Manipulation checks :
Simply test whether (or) notSimply test whether (or) not
your independent variables hadyour independent variables had
the intended effects bon yourthe intended effects bon your
participants .participants .
A set of measures are ask theA set of measures are ask the
participants report theirparticipants report their
perceptions of the entireperceptions of the entire
experiment .experiment .

July 30, 2017July 30, 2017
CONCLUSIONCONCLUSION
In conclusion , it is importantIn conclusion , it is important
to carry out pretests , pilotto carry out pretests , pilot
studies and manipulationstudies and manipulation
checks . They are importantchecks . They are important
steps in the entire researchsteps in the entire research
process for discoveringprocess for discovering
problems and improving theproblems and improving the
planned study .planned study .

July 30, 2017July 30, 2017
I HOPE I HAVE
GIVEN YOU A
GOOD
PICTURE
OF
PILOT

Pilot study

More Related Content

What's hot

Similar to Pilot study

More from chettinad college of nursing

Recently uploaded

Pilot study