Validation of Microbiological Methods

www.drugragulations.org 1
Presentation prepared by Drug Regulations – a not for
profit organization. Visit www.drugregulations.org for
the latest in Pharmaceuticals.

This presentation is compiled from papers
published by experts like Sandle, T , Newby, P  ,
Hussong, D.; Mello, R.   Friedman, E.M.; Warner,
M.; Shum, S.C.; Adair, F and various
pharmacopeias
“Drug Regulations” is a non profit organization
which provides free online resource to the
Pharmaceutical Professional.
Visit http://www.drugregulations.org for latest
information from the world of Pharmaceuticals.
14-01-2016 2
Drug Regulations : Online
Resource for Latest Information

This presentation is compiled from freely available
resource like the website of WHO, specifically the
WHO Guidance on
Quality Risk Management
14-01-2016 3

4
 This presentation gives an overview
of
◦ Validation of microbiological methods
◦ Considering some of the limitations
◦ Key criteria that may be applicable for
assessment.

 Analytical methods designed to recover
chemical substances have less variation
 On the other hand high variation is seen with
many Micro methods
◦ Especially those based on culture
 In spite of this Microbiology has become an
exacting science
5Drug Regulations : Online Resource for Latest Information

 Micro methods may not meet the exact
demands of analytical ones
 Significant progress in rapid microbiological
methods and alternative techniques
 Many novel methods use automation and data
capture with statistical analysis
 Validation approaches need to consider these
developments

 Validation, in this context, can be defined as
 “Process by which it is established, by
laboratory studies, that the performance
characteristics of a method meet the
requirements for the intended application”

 Important objectives of validation is
determining
◦ Whether the sample to be examined has any
inherent anti-microbial properties and
◦ Whether the incubation and growth conditions can
recover microorganism that may be present to an
acceptable level.

 Following should form the basis of validation strategy
and be considered in drawing up assessment criteria
 Limit of detection
◦ What is the lowest level of microorganisms that can be detected
 Specificity
◦ What range of different microorganisms can be detected
 Quantification
◦ The counting accuracy

 Suitability of criteria will depend upon
◦ The state of the method: automation /
sophistication
◦ Limit quantification or detection required.

 This presentation provides a set of
criteria and explanation, which can be
considered to build a validation
protocol and experimentation.

 Broadly fall into three major
categories

 Qualitative tests
 Tests for the presence or absence of microorganisms
◦ e.g. the pharmacopoeia sterility test.
 Commonly, qualitative tests are assessed through the
use of turbidity or other growth related changes in a
culture medium
◦ These serve as evidence of the presence of viable
microorganisms in a test sample.

 Quantitative tests
 Tests for the enumeration of microorganisms
 Total viable count test
 Flow cytometry.

 Identification tests
 Speciation of bacteria using a biochemical test
 Morphological and biochemical characterization
 Biochemical reactions
◦ Carbon substrate utilization
◦ Characterization of fatty acid composition
◦ Restriction endonuclease banding patterns
◦ Use of 16S or DNA sequence analysis

 Methods in each category have a different variability
 These variations are inherently different from analytical
ones
 The wide variability is acknowledged in Ph. Eur. 5.1.6
 Chapter relating to alternative microbiological methods
 This is particularly with regards to relative broad
ranges.

 Reason for the variation
 Microbiology is a logarithmic science.
 Microbiological methods are capable of
distinguishing between 100 and 1000 cells (1
log)
 However smaller differences, such as 0.3 or
0.5 of a log can not be distinguished.

 In other words e.g.
 17 CFU is technically no different than 10
CFU; and
 1 CFU is different than 10 CFU but not 5 CFU.
 Culture based methods provide estimates
rather than exact cell counts.

 Variability may result in difficulties in comparing
two methods.
 In general, only a 50% comparison is achievable
for culture methods.
 With rapid and alternative microbiological
methods greater comparability can be achieved
 However levels of precision remain in the order
of 15 to 35% relative standard deviation

 Culture based microbial methods
 Validation is limited by the ability of
microorganisms to reproduce under a set of
conditions in relation to
◦ Sample preparation
◦ Cultivation
◦ Incubation.

 Any method is, therefore, a general indicator
only.
 For these methods, as described in the
pharmacopeia, the limit of detection has
never been established quantitatively.

 Many variables can affect recovery. These
include:
◦ Growth media
◦ The colony forming unit or “CFU” is not a true cell
count
 Individual cells are rare in nature, leading to the CFU
being an underestimation of the number of
microorganisms present

 Many variables can affect recovery. These include:
◦ Incubation conditions (temperature and time),
◦ Nutritional requirement of the organism
◦ Physical condition of the organism
 Stressed or sub lethally damaged due to temperature,
humidity, high ionic strength, pH extremes, osmotic shock
(relating to liquid),
◦ Residues of antimicrobial chemicals

 Many variables can affect recovery. These
include:
◦ Dilution errors
◦ Environmental organisms are unlikely to be recovered when
they are in the exponential growth phase
 exponential growth leads to better recovery
◦ Characteristic of the item under test
◦ The types of neutralizers used

 With non-culture based methods,
these are unlikely to be affected by
the list given earlier

 Method comparison is required
for
◦ Introduction of a new method
◦ Replacement of one method with
another

 New methods will most probably
recover grater number of organisms
compared to the older method

 Positive or higher result with an
alternative method
 Negative or lower result with an
established method
 Does suggest that the positive result
is a false positive.

 Similarly because greater numbers of
organisms may be recovered with an
alternative method, does not mean
that the risk is now greater.
 This is normally because of process
controls in place.

 Revision of limits in light of greater
microbial recoveries needs careful
considerations
 In evaluating an alternative method a
close match is not necessarily required,
between the alternative method and the
current method.

 Important consideration
 Alternative method should be capable
of allowing an equivalent decision to
be made in relation to sample or
product quality in a consistent
fashion.

 Define the objective and hypothesis
appropriately.
◦ Hypothesis
 This is a statement concerning an expected
outcome of the experiment
 The experimental result will prove or
disprove the hypothesis.

 The objectives for the experiment should
be
◦ Specific
◦ Measurable
◦ Achievable
◦ Realistic
◦ Time based

 In defining the objectives, the following should be considered:
 Validation requirements
 Test controls
 Microorganisms
 Type of data/statistical analysis
◦ this is an area requiring care, especially when comparing compendial methods
with alternative ones
 How many times does the experiment need to be run?
 How many samples are required?

 As part of a study, preliminary work method development may be
undertaken when drawing up of a protocol.
 This gives some idea about the capability and limitations of the
method
 Helps with the development of appropriate assessment criteria.
 Doing so also helps to determine if there are aspects within the
protocol that require clarification;
 Helps determine the planning of the study
◦ e.g. culture media requirements, number of technicians required and so on

 Following slides list aspects of
experimental design that need to be
considered and incorporated into the
design stage.

 Samples
 The size of the test sample must be considered.
 Importantly, the number of samples must be
representative and of a sufficient number.
 A statistical technique may be used to set the number
of samples required.
 Care must be taken here since the statistical
technique selected may influence the sample size.

 Samples
 The appropriate volume of sample may be a factor,
particularly with bioburden testing
 Ensuring that the sample tested is representative of the
final homogenous bulk is important.
 For most validation exercises the number of batches tested
is three (or more).
 With areas like environmental monitoring, consideration
should be given to the location of samples, such as the
number of locations within a cleanroom.

 Samples
 Consideration should also be given to:
 Testing samples at the end of the shelf-life or expiry time
◦ this may include assessment at interim time points
 Degrading samples stored in containers;
 Holding samples under “worst case‟ conditions
◦ upper or lower temperatures
 Testing samples at the end of any required process hold
times.

 Samples
 The above points are applicable to many
bioburden and bacterial endotoxin tests.
 Any pre-requisite treatment of the
sample, e.g. neutralization, or
microorganisms (promotion of
reproduction) should be considered.

 Microorganisms
 An experiment normally requires a range of
microorganisms.
 For all experiments, microorganisms from an
approved culture collection should be used
 This ensures uniformity and traceability.
 In some cases compendia will indicate the types or
even specific strains of the microorganisms required
◦ e.g the sterility test chapter within the main pharmacopeia

 Microorganisms
 In other cases, the microorganisms will need to
be selected based on professional judgment.
 Experiments may be supplemented by
environmental isolates, or 'wildtypes', as
appropriate
 Normally appropriate when a culture medium is
used to monitor a production process

 Microorganisms
 In selecting microorganisms it is often a good idea to draw
these across a range of different morphological types.
 Suitable categories include:
◦ Gram positive rod and/or a Gram positive spore bearing rod, e.g.
Bacillus sp.
◦ Gram positive cocci e.g. Staphylococcus aureus
◦ Gram negative rod e.g. Pseudomonas aeruginosaiv)
◦ Fungi, (yeast), e.g. Candida albican
◦ Fungi (filamentous), e.g. Aspergillus brasiliensis

 Microorganisms
 In all instances either the specific culture collection
reference must be quoted or the source of the isolate
identified.
 For certain Gram-positive bacteria, the protocol
should specify if the organisms should be in the
endospore state.
 The type of experiment must be considered when
allocating microorganisms.

 Microorganisms
 A project involving the examination of
water would most likely require
 A Gram negative rod (such as
Pseudomonas sp.) and
 A coliform (such as Escherichia coli).

 Microorganisms
 In contrast, an experiment conducted at 55°C
◦ as with a test for thermophilic microorganisms
would involve
 A thermophile such as Geobacillus
stearothermophilus.
 Consideration should also be given to the
storage of cultures.

 Microorganisms
 Sometimes microorganisms are not recovered as expected.
 This is a case for carrying method development work in advance.
 An example of poor recovery can occur with Gram-negative rods.
 With these organisms, desiccation can occur during aerolisation.
 This may occur when using an active air sampler or following loss
of moisture content in an exposed settle plate surface.

 Microorganisms
 This effect tends to damage Gram-negative
bacteria more greatly.
 This is because soluble cell contents tend to leak
 Mechanisms to control the transfer of molecules
and ions in and out of Gram-negative cells in
particular are considerably impaired.

 Microorganisms
 Damage to the mucopeptide
lipopolysaccharide center cell structure also
causes cell damage and loss of viability.
 Such damage occurs very shortly after weight
loss to a medium or after aerolisation.
 Such cell damage is typically irreversible

 Microorganisms
 Microorganisms used should normally be
prepared from
◦ Cultures which are no more than 24 hours only
and
◦ No more than five passages from the seed lot.

 Microorganisms
 However, some microorganisms require longer cultivation
than 24 hours.
 In these instances the culture age must be documented in
advance to ensure that the culture used is as young as it
can be.
 With passages (or subcultures), this is to prevent
phenotypic variations from occurring which might influence
the way the microorganism behaves in the presence of the
sample.

 Microorganisms
 It is good practice that the purity of cultures
is confirmed in advance.
 This can either be by
◦ Acceptance of a certificate of analysis from the
supplier of the cultures, or
◦ By confirmatory identification conducted by the
recipient laboratory.

 Microorganisms
 In some circumstances, such as when
conducting a challenge test, a post
identification confirmation may also be
deemed necessary.
 With some experiments, an attempt may be
made to induce a stressed state to the
microbial population.

 Microorganisms
 This will need to be decided at the time of
writing the test protocol.
 The reason for attempting this is based
on the “unstressed” batch culture grown
organisms being are an artificial creation
that rarely exists outside the laboratory.

 Microorganisms
 Stress factors faced by microorganisms in the environment
include:
◦ Desiccation,
◦ Nutrient deprivation,
◦ Nutrient limitation,
◦ Cold shock,
◦ Heat shock,
◦ Exposure to ultra-violet light,
◦ Other types of radiation leading to sublethal damage,
◦ Responses to disinfectant or detergent residues,
◦ Responses to preservative residues,
◦ Osmolality.

 Microorganisms
 Creating a stressed state is difficult in itself
and difficult to verify, given the unknown
effects of causing damage to cells or with
suppressing cellular growth.
 In addition, the age of a culture will affect its
recovery and will be important for certain
identification methods.

 Temperature
 Consideration needs to be given over the temperature ranges the
experiment needs to be performed at.
 Here there is little value in restricting validation to one
temperature range for testing that takes place over multiple
ranges.
 An example here would be testing culture media at 20-250C
 Then using it across the range 20-400C and expecting its growth
promoting properties to be consistent.

 Temperature
 Commonly used ranges include:
◦ 2°C - 8°C,
◦ 20°C - 25°C,
◦ 30°C - 35°C,
◦ 36°C - 38°C
◦ 55°C - 60°C

 Temperature
 In addition to the above, dual incubations
across two or more ranges may be
required
 This is for the enumeration of bacteria
and fungi with a single-use culture
medium for environmental monitoring

 Time
 As with temperature, consideration needs to be given to the
time period over which the study is to be conducted.
 Getting this right is important since the selected time
becomes the maximum run-time for the test.
 It is important to ask if incubation time is set long enough
to show the limit of detection?
 The time of the validation read must never exceed the time
used by the testing laboratory for the reading of samples.

 Time
 Specification for incubation times the minimum time must
be clearly stated.
 For example, “incubate plate at 20-25oC and read at 24
and 48 hours” rather than “incubate plate at 20-25oC and
read after 48 hours.”
 Consideration of acceptable tolerance should be stated.
 Is “read at 48 hours”, for instance, reading within ±1 hour
of 48 hours or will a wider tolerance be used, and with what
justification?

 Growth Promotion
 A key question here is:
 What type of growth promoting conditions is
required for the cultivation of microorganisms?
 This would include different types of agars,
broths, dilution reagents and so on.
 These may require a separate or first phase
validation.

 Atmosphere
 Whether the microorganism(s) to recover are obligate aerobes,
facultative aerobes/anaerobes, microareophilic, capnophiles, or
obligate anaerobes, should be considered.
 A microaerophile, for example, is a microorganism that requires
oxygen to survive, but requires environments containing lower
levels of oxygen than are present in the atmosphere
◦ that is <21% O2; many require 2-10% O2
 Once established it will be known whether a specific combination of gases is
required, for example, CO2N.

 Antimicrobial Activity/Interference
 Note should be taken of whether any of the experimental
conditions produce an antimicrobial effect or interfere with
the test in way of enhancement or inhibition.
 Attention should be paid to the best method for
neutralizing any anti-microbial properties.
 Common methods for neutralization include dilution,
rinsing, filtration or the use of general or specific
neutralizers.

 pH
 Note should be taken of pH conditions.
 pH is important to microbial growth and
certain ranges will be unsuitable for some
microorganisms.

 Growth Phase
 The growth phase of a microbial population can
impact upon the accuracy of a method, for example, a
turbidity method.
 Ordinarily, in culture, the following growth dynamics
are observed
 Cells initially adjust to the new medium (lag phase).
 Cells maybe growing by mass, but not in number.

 Growth Phase
 Lag phase is influenced by
◦ Size of the inoculum;
◦ Time to recover from physical damage;
◦ Time required for synthesis of essential coenzymes;
and
◦ Time required for synthesis of new enzymes
necessary to metabolize the substrates present in
the medium.

 Growth Phase
 Cells then start dividing regularly by the
process of binary fission (exponential phase).
 Here cells divide at a constant rate,
expressed as generational or doubling time.
 Ideal generation times wider according to
different microbial species.

 Growth Phase
 Escherichia coli, for example, will double every
17-20 minutes, whereas Mycobacterium
tuberculosis doubles every 790-930 minutes.
 When their growth becomes limited, the cells
stop dividing (stationary phase).
 Eventually cells show loss of viability (death
phase).

 Number of Microorganisms
 Some methods will require a minimum number of
microorganisms in order to detect them.
 For example, a method linked to microbial
catabolism; adenosine triphosphate (ATP)
growth; bioluminescence etc.
 A pre-growth preparatory step may be required
in order to maximize recovery.

 Single Cultures
 Most methods require a single (pure) culture in order
to obtain a valid result.
 Mixed cultures can be employed in certain
circumstances
◦ e.g. container closure integrity.
 Here, care must be taken that one microorganism
does not significantly out-grow the other.
 In general, mixed cultures should be avoided.

 Enzymes
 When detecting presence of specific
microorganisms using a selective
medium, the specificity and selectivity of
the microorganism and media must be
demonstrated using selective and non-
selective microorganisms.

 In studying a microbiological method, different validation
parameters require assessment.
 Not every parameter will be appropriate,
 Either due to the nature of the method (qualitative or quantitative)
 Or due to its capabilities
 A modern, rapid microbiological method, for example, will have
been designed to meet more parameters than an older cultural
method.
 Several of the categories have been revisited by microbiologists in
light of the emergence of rapid and alternative microbiological
methods

 Specificity is the capability of the method to resolve or
measure a range of microorganisms in the presence
of other compounds or microorganisms.
 This may be a single microorganism (such as a test
for coliforms) or a range (such as a general bioburden
test).
 Freedom from interference from excipients or active
pharmaceutical ingredients, degradation products or
impurities must be noted as part of a recovery
(accuracy) study.

 Where selecting an appropriate culture medium is
part of the study, the properties of the medium
against selective, non-selective and mixed
cultures must also to be considered.
 The microbial challenge should be set above the
limit of detection or quantification, while also
being at level that provides a measure of the
efficacy of the method.

 For a growth based method, a low number of <100 CFU is
appropriate.
 All challenge microorganisms should be recovered.
 Where atypical colony morphology is observed, supporting
identification should be considered.
 For a non-growth based method, suitable positive and
negative controls should be used to show that any
extraneous matter does not interfere with the detection of
the microorganisms.

 A new method or test must demonstrate that it is
appropriate for its intended use.
 If a method or test is intended to replace an established
method,
◦ Parallel testing of both methods must take place
◦ The collected data compared if possible, ideally by statistical tests
of significance.
 In some cases, a direct comparison is not possible
◦ Two different models of particle counter cannot be directly
compared because they will not be sampling the same volume of air

 Accuracy is the closeness of agreement
between the “measured value” and the “true‟
or “expected” measure or reaction across the
range of the test.
 This can be assessed by determining the
recovery of known quantities of a
microorganism that has been added to a
sample.

 For quantitative tests, this is predicted from:
◦ The dilution of a microbial suspension; or,
◦ By examining for presence/absence; or,
◦ From a taxonomic identification; or,
◦ By comparing the new method to an established
test method
 Here the new method must give equivalent or better
results to the established method

 For enumeration methods, the level of recovery should
reflect the test method.
 This is normally by the percentage of microorganisms
recovered by the method.
a. If good recovery is considered to be achievable, then a recovery
level of 50% should be the minimum (this can also be expressed
as a productivity ratio). Where an upper level of recovery is
required, this is normally set at 200% (with a range of 50-200%
quoted).
b. When comparing between two methods, 70% is sometimes set
although other acceptance criteria may be appropriate.

 Comparison of accuracy can be further
examined by significance testing, such as
Student's t- test or an alternative method.
 For example, accuracy can be expressed as:
 Accuracy % = (Number of Correct Results in
Agreement/Total Number of Results) x 100

 For qualitative methods it is recognized that many
hundreds of comparisons may be required if a
negative result is the expected outcome, such as with
the sterility test.
 A limitation must be established in relation to the
number of samples;
 This is because testing samples until a positive result
is obtained will be impractical.
 When comparing two methods, the relative rates of
positive and negative results should be compared.

 Precision
 Precision is the closeness of agreement between
a series of test results or the variation in a series
of test results, when a method is applied
repeatedly to multiple samples.
 Precision can be subdivided into:
◦ Repeatability (within test variation)
◦ Intermediate Precision

 Repeatability (within test variation).
 This is the variation in results obtained on
the same sample when assayed repeatedly
with one test or within a short period of
time, by the same technician using the
same reagents and equipment.

 The key to acceptability is the amount of variation. It may be
expressed as:
a. Standard deviation
b. Coefficient of variation (relative standard deviation)
c. Confidence interval of the mean
d. With specific tests, such as microbial identification systems, other
criteria will be used to determine the similarity of the recovered
organisms.
e. Other statistical techniques like Chi-squared, maybe more appropriate

 Normally at least 3 replicates are required.
 Depending on the types of sample, more than one
determination may be required (for example different dilutions
or a range of microorganisms).
 Because the testing technician and consumables are the same,
this approach shows variation in sample as assessed against
the method.

 Intermediate Precision
◦ This is the variation in results obtained
on the sample when assayed on
several separate occasions by different
technicians using different reagents
and equipment etc.

 This shows reproducibility. This may be expressed as:
a. Standard deviation,
b. Coefficient of variation (relative standard deviation),
c. Confidence interval of the mean.
d. With specific tests, such as microbial identification systems,
other criteria will be used to determine the similarity of the
recovered organisms.
e. Other statistical techniques like Chi-squared, maybe more
appropriate.

 A minimum of three determinations should be carried
out.
 Appropriate acceptance criteria (such as ≥95%) should
be set for repeatability.
 This approach shows variation across people and
reagents, and variability within the method.

 Range is the interval between the
upper and lower levels of microbial
count, for which the procedure has
been established as suitable with
accuracy, linearity (if appropriate,
where there is requirement to
construct a curve), and precision.

 For example, the commonly used range for
microorganism recovery is less than 100 CFU for
total count techniques.
 Where a range is required, in order to assess the
range of the test, this is covered by diluting a
microbial population; for example, 100 to 106 cells.
 With some methods, a regression analysis can be
considered to compare two methods.

 Robustness is the reliability of a method or test
to withstand small (but deliberate) variations
due to external influence.
 For example, different technicians,
instruments, incubation time,ambient
temperature, and reagents.
 With rapid methods, robustness can be
undertaken by the method supplier.

 However, once in the laboratory, long term
performance must be considered and, if possible,
checked by internal control samples.
 For example, the distribution of microorganisms on
a membrane can affect robustness.
 Ruggedness is the degree of reproducibility by
testing samples using different testers and
equipment;
 this is assessed by coefficient of variation.

 This is the lowest number of microorganisms
which can be detected, but not necessarily
quantified (such as a low level challenge) under
the stated experimental conditions.
 This test is generally used for rapid and
alternative methods.

 Often the amount of sample tested the initial
dilution of the sample and any subsequent dilution
of the sample may determine the limit of detection.
 The challenge microorganisms selected should be
of an appropriate range as indicated above).
 The challenge can consist of taking each
microorganism and making a serial dilution range.

 The outcome can be expressed as
presence/absence or enumeration.
 Presence/absence is normally qualitative.
 An attempt can be made for a semi-
quantitative analysis by varying the microbial
challenge
◦ to develop a limit test, i.e. to detect <100 CFU, <10
CFU etc.

 It is recognized that the act of dilution may result in a
greater loss due to lack of homogeneity and the typical
Poisson distribution of microorganisms in liquid;
 such as in the evaluation of a raw material by using the
pour plate method and where the limit of detection is
<10cfu/g.
 This is further complicated by the impossibility of
obtaining reliable samples containing a single
microorganism.

 Therefore, microbiologically limits of detection must
sometimes be considered as theoretical rather than
practically demonstrable.
 For this reason, many pharmacopeial` tests require the
use of a low level challenge (<100 CFU) and this is
normally considered sufficient.
 For comparing methods Chi-squared is often the
statistic of choice.

 This is the lowest level of the sample where the
microbial content can be quantitatively
determined with defined precision and
accuracy.
 Again, further complication arises by the
impossibility of obtaining reliable samples
containing a set number of microorganisms.

 Therefore, microbiologically limits of detection
must sometimes be considered as theoretical rather
than practically demonstrable.
 Many pharmacopeial tests require the use of a low
level challenge (<100 CFU) and this is normally
considered sufficient.
 Limits of quantification are normally determined by
3 or more replicates across the range.

 This is the ability to elicit results which are
proportional to the concentration of
microorganisms within a given range.
 This is measured by correlation coefficient or a
goodness of fit test (such as Chi-Square).
 This will only be applicable to enumeration
methods using an analytical system.

 For qualitative tests such as the sterility test or
growth of selective media, the use of positive
or negative predictive values may be
appropriate.
 This can be expressed as a percentage of the
observed test results against the total or
expected test results.

 Rapid and alternative microbiological methods embrace
those methods that are distinct from compendial
methods.
 Rapid indicates that the method gives a faster time-to-
result and alternative indicates that the method differs
from one presented in a recognized pharmacopeia
 In many cases such methods are more accurate and they
are invariably automated
 Although this is not always the case

 Given the pace of technological development and commercial
gains, such methods are becoming more common
 When considering the introduction of an alternative method, the
following should be considered
 Prepare a User Requirement Specification.
 Consider instrument qualification; validation requirements of the
alternative technology and aim
◦ e.g. to be equivalent to current methods or to improve upon a current method
 Method suitability
◦ e.g. sample volume requirements, critical parameters of compendial test,
suitability for a range of different products to be tested

 Sample size and number of samples:
 With a new method, it may be appropriate to assess all parameters on one type of
product and then to run method suitability tests only on other products against
the same method.
 In terms of results interpretation, non-growth based methods (such as those
looking at metabolic activity or ATP) will provide more accurate cell counts and
these are not comparable with growth-based estimates of colony forming units.
 Results from alternative methods, such as cell count, cannot be compared
statistically to CFU results from culture based methods.
 Data handling.
 Test controls e.g. use of control microorganisms.
 Consideration of test limits for samples tested by alternative methods.

 With alternative methods the aim is to
verify the detection capability of the
alternative method.
 In terms of parameters to review, the
following acts as guidance (based on
USP chapter <1223>)

 With the above, a degree of interpretation is required. It follows:
 Method suitability: accuracy, precision and specificity (recovery of challenge
organisms) for quantitative methods; for qualitative methods, only
specificity would apply.
 Robustness is assessed as above. It is not directly compared with a current
method. Manufacturer‟s data may be considered.
 Ruggedness is assessed as above.
 It is not directly compared with a current method. Manufacturer‟s data may
be considered.
 Limit of detection: this is assessed by using a range of microorganisms.

 Approach #1:
 Each organism is prepared as a serial dilution,
with the inoculum adjusted to a target of 50%
that shows growth in an existing method.
 Both methods should be run over several
replicates.
 An appropriate statistical comparison method
is Chi- squared.

 Approach #2:
 Most Probable Number (MPN) method is used.
 For a ten-fold series a range of 10-1 to 10-2
microorganisms is used; or for a two-fold series,
using the range 5 to 10-1 microorganisms.
 The alternative and established method should be
run five times using 3 dilutions
◦ the dilutions should provide at least one positive and one
negative dilution
 Chi- squared is an appropriate statistical tool for
method comparison.

 Where the aim is to show equivalence between
two methods, there are four possible ways to
assess this (again as referenced in USP
<1223>).
 The appropriate category should be selected in
advance of conducting the validation and
referenced in the validation protocol.
 The options are: ( See next slide )

 The options in earlier slide can be interpreted
as:
1. Acceptable procedure: this is not strictly an
equivalence option, it is about the new method
meeting a minimum performance or acceptance
requirement.
◦ The qualification may involve a standard inoculum
with a range of microorganisms to assess recovery,
or a level of ATP.

 The options in earlier slide can be interpreted as:
2. Performance equivalence: better or equivalent
results are required from the new method
compared with the existing method.
◦ This is with regard to: accuracy, precision,
specificity, limit of detection, limit of
quantification, robustness and ruggedness
(only those factors that are relevant require
inclusion).

3. Results equivalence: this is similar to
performance equivalence expect with the added
requirement that the new method must give
equivalent or better numerical results.
◦ Because the same sample cannot be tested
against two methods, a tolerance value is
required.

4. Decision equivalence: this is similar to results
equivalence with the exception that „pass‟ or
„fail‟ results are compared (as with a „growth‟
/ „no growth‟ test result).
◦ It is also possible to consider a Most Probable
Number method for qualitative tests.
◦ When evaluating instruments there should be a one-
sided inferiority hypothesis.

This presentation is compiled from papers
published by experts like Sandle, T , Newby, P  ,
Hussong, D.; Mello, R.   Friedman, E.M.; Warner,
M.; Shum, S.C.; Adair, F and various
pharmacopeias
14-01-2016
11
7

www.drugragulations.org
11
8
Presentation prepared by Drug Regulations – a not for
profit organization. Visit www.drugregulations.org for
the latest in Pharmaceuticals.

Validation of Microbiological Methods

More Related Content

What's hot (20)

Similar to Validation of Microbiological Methods (20)

More from GMP EDUCATION : Not for Profit Organization (20)

Recently uploaded (20)

Validation of Microbiological Methods