Statistical Comparison of Immunogenicity Cutpoint

Download Report

Transcript Statistical Comparison of Immunogenicity Cutpoint

Statistical Comparison of Immunogenicity Cutpoint Factors Using Log Transformation

Dingzhou (Dean) Li PharmaTx Statistics, Pfizer Global R&D MBSW, 2010

Definitions

•

Immunogenicity:

– Causing or capable of producing an immune response. – Unwanted for target-binding drugs – Desired for vaccines – Assay required for FIH •

Anti-drug antibody (ADA)

: – Binds to a portion of the drug thus preventing the drug from binding to its target – Affects the conformation of the drug so that when it binds to its target it is not functional. – Cross reactivity with endogenous proteins ; greatest regulatory concern

Immunoassays

Bridging ELISA Bridging ECL Sandwich (non bridging ELISA)

Biotin labeled drug SA-HRP ADA Drug Biotin Drug ADA ADA Detection Antibody/reagent:HRP Drug Fab

From Quantitative to Qualitative

• Quantitative – Continuous units of reference standard • Qualitative – Reference standard is not available – Ordinal or nominal •

Quasi-quantitative

– Continuous units of signals

Endpoint Titer: A quasi-quantitative method

• A way of expressing [Ab] in blood or serum • Related to the number of times you can dilute a sample of serum and

still detect

Ab • Titer = Reciprocal of the last dilution of a titration giving a measurable effect. – Reported log2 of the titer.

Endpoint Titer Example

2000 1000 800 600 500 400 300 200 0 Titer=1894222 1000000 2000000 Dilution 3000000 cutpoint

Cutpoint

• Cutpoint: Positive vs. Negative • How to calculate cutpoint?

– Pooled negative controls (PNC) – Cutpoint = Mean(PNC) + c α *SD(PNC) – c α : Critical value at significance level α, depending on underlying distribution (e.g. c 0.05

= 1.645 for normal distribution) – Parametric or nonparametric • Screening vs. Confirmatory

Cutpoint Factor

• For each plate in production, want to readily get the plate-specific cutpoint • Multiply the mean PNC by a factor – Cutpoint = Mean(PNC) * CPF • Need two steps…

Two Steps

• Step 1: Cutpoint factor determination – Negative control only • Step 2 : Production – Negative control, positive control, patient samples on the same plate – Endpoint titer, inference, sensitivity, etc

Step 1: Cutpoint Factor Determination

• 150 samples distributed on 6 plates – Sample: a serum sample from a subject • For each plate, – CPF (Plate) = Cutpoint (Plate)/Mean(Plate) • Average CPF for all the plates to get an overall CPF – This is the CPF for Step 2

Step 1: Pooled Negative Controls

275 250 225 200 175 150 125 0 10 20 30 Negative Control Sample 40 50 cutpoint

Determination of CPF from PNC

Cutpoint CPF Overall CPF

Plate 1

Sub 1 Rep 1

Plate 2

Sub 26 Rep 1

Plate 3

Sub 1 Rep 2

Plate 4

Sub 26 Rep 2

Plate 5

Sub 1 Rep 3

Plate 6

Sub 26 Rep 3 Sub 2 Rep 1 … Sub 27 Rep 1 … Sub 25 Rep 1 275 Sub 50 Rep 1 1.19

1.25

Sub 2 Rep 2 … Sub 25 Rep 2 1.15

150 Sub 27 Rep 2 … Sub 50 Rep 2 1.19

Sub 2 Rep 3 … Sub 25 Rep 3 1.17

209 Sub 27 Rep 3 … Sub 50 Rep 3 1.31

1.21

Step 2: Typical Production Plate Layout

ID E F G A B C D H

Rep 1 1 Rep 2 Rep 3 Rep 4 Rep 5 Rep 6 Rep 7 Rep 8 Rep 1 2 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 2 3 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 1 4 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 5 Rep 1 6 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 7 Rep 1 8 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 9 10 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 Rep 1 11 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 Rep 2 12 1000 2000 4000 8000 16000 32000 64000 128000 NC PC sample1 sample2 sample3 sample4 • Cutpoint = Mean(NC) *

Overall CPF

1) (from Step • Use the cutpoint for endpoint titer calculation

Comparing Cutpoint Factors

• Are CPFs the same at different setups? – Reagent lot, serum type, etc – Important for process improvement – Decision making • How to compare CPF with repeated measures?

– A subject may contribute multiple samples

Statistical Treatment of CPF

• Note for a certain plate, CPF = (Mean+ c α *SD)/Mean = 1+ c α *CV • CV has a noncentral t-distribution (Johnson and Welch, 1967) – Computationally difficult (though tools do exist) – Hard to extend to repeated measure scenarios • Alternative: Log-transform – In many cases, the signals (relative light units) are approximately log-normal

Example: 25 Samples

130 140 150 160 170 180 190 200 210 Normal(158.68,17.8202) LogNormal(5.06118,0.10533) • Goodness of fit – Normal: p = 0.02 (S-W test) – LogNormal: p = 0.10 (Kolmogorov’s D)

Log-transform Approach

• It is well known that if

X

then CV(

X

) = exp(  2 )  1 ~ log

normal

(  ,  2 ) • When σ is small, exp(  2 )  1   • So statistical inference can be based upon variability of the logged data

Example: 25 Samples

130 140 150 160 170 180 190 200 210 Normal(158.68,17.8202) LogNormal(5.06118,0.10533) • Noncentral t-distribution – CV = (0.088, 0.157) – CPF= (1.145, 1.258) • Log-transform – CV = (0.084, 0.150) – CPF = (1.138, 1.247)

Homogeneity of Variability

• Levene’s test – Fit 1 st ANOVA to get residual variability estimate – Fit 2 nd ANOVA on abs(residual) to test equal variance – Readily extends to repeated-measure cases • Models: –

i

: Lot;

j

: replicate;

k

: subject – 1 st ANOVA: RLU

ijk

=

μ

+ replicate

kj(i) =>

Get residuals r

ijk

– 2 nd ANOVA • Within-lot: r

ijk

• Between-lot: r

ijk

=

μ

=

μ

+ replicate

j(i)

+ lot

i

+ ε

ijk

+ ε

ijk

+ subject

k

+ ε

ijk

Example

Variability Chart for Log(RLU)

10.5

• Two different reagent lots • Three plates at each lot • Samples from 30 subjects 10.0

9.5

9.0

• Results: – In Lot 1, Plate

a2

has higher variability than other plates – No significant difference in variability between Lots 1 and 2 8.5

a1 Rep w ithin Lot a2 1 0.20

0.15

0.10

0.05

0.00

a1 Rep w ithin Lot a2 1 a3 a3 b1 b1 b2 2 b3 b2 2 b3

Discussions

• Cutpoint analysis is crucial in various applications of the endpoint titer method • Cutpoint in most cases depends on the plate, experimental parameters, etc. So using a fixed cutpoint is not recommended • Uncertainty in CPF will translate to error in the endpoint titer

Acknowledgements

• Daniel Baltrukonis – Immunotox CoE • Jessica Duffy – Immunotox CoE • David Potter – PharmaTx Statistics