Abstract
Enzyme-linked immunosorbent assay (ELISA) has been described as the gold standard for serum cytokine analysis. However, multiplex array technologies are increasing in popularity, likely because of their ability to analyze large numbers of analytes with low sample volume compared to ELISA. Few studies have directly compared serum cytokine results from ELISA and Multiplex analytical techniques. Therefore, the purpose of this observational research was to determine if differences exist in serum cytokine concentrations between ELISA and Multiplex techniques. Blood samples were collected from the antecubital vein of professional American football players during a competitive season to monitor biomarkers fluctuations throughout the season. After clotting, blood was centrifuged and three 300 μL aliquots of serum were frozen at -80°C. IL-1β, IL-6, and TNF-α were measured from the exact same serum samples using ELISA (EMD Millipore, Sigma Aldrich) and Multiplex (EMD Millipore, Magpix) kits.
Coefficients of variation (CV%), paired samples t-test with 95% CI, and Pearson’s product-moment correlations were used to compare cytokine analysis techniques. Descriptive statistics are shown as mean ± SD. Results indicated that serum cytokine concentrations were not comparable between ELISA and Multiplex analytical techniques. IL-1β (n=15) displayed significant variability between techniques with a CV% of 119.9 with ELISA reading 36.8 ± 32.4 pg/mL, intra-assay CV%= 7.6 and Multiplex showing 1.1 ± 1.2 pg/mL, intra-assay CV%= 6.8. IL-6 (n=33) demonstrated substantial variability between techniques with a CV% of 126.9 with ELISA reading 340.2 ± 460.5 pg/mL, intraassay CV%= 15.3 and Multiplex showing 11.8 ± 20.2 pg/mL, intra-assay CV%= 4.8. For TNF-α (n=36) all ELISA samples were below the detection limit of 0.31 with the Multiplex detecting 8.8±3.2 pg/mL, intra-assay CV%= 7.9. Moreover, paired samples t-tests showed considerable mean differences between analysis techniques for IL-1β (-35.8 pg/mL, (95% CI, -51.6 to -19.9) t(17) = -4.8, p < 0.001) and IL-6 (-328.4 pg/mL (95% CI,-490.0 to -166.7), t(32)= -4.1, p < 0.001.
Pearson’s correlation between ELISA and Multiplex was not significant for IL-1β [r(13) = 0.44, p = 0.068] or IL-6 [r(31) = 0.25, p = 0.157]. The results suggest that ELISA and Multiplex outcomes were not comparable and the differences in blocking agents used may be the source of erraticism. According to the results from this study, comparisons between analytical techniques should be avoided and more work is needed to determine the cause of these large discrepancies seen between methods.
Introduction
Inflammation is a protective response that is necessary for responding to invading pathogens. Cytokines, secreted by immune cells, play a major role in this response. Measurement and detection of cytokine levels in serum are essential in understanding biological homeostasis to maintain human health. Investigation of cytokines in serum analysis has been classically conducted by enzyme-linked immunosorbent assay (ELISA). With an increasing demand for rapid and precise measurements for multiple cytokines and other biomarkers, ELISA has been the standard for quantitative serum analysis. Yet, it is not well suited for high throughput multiple biomarker detection [5]. Compared to ELISA, multiplex arrays provide quantitative measurement of multiple cytokines on a largescale using bead-based technology. This sought-after assay offers a quantitative measure of multiple cytokines on a large-scale using bead-based technology. Thus, further analysis of these two methods for quantitative serum cytokine analyses is necessary.
ELISA has been classically described as the gold standard for serum cytokine analysis [14]. Also known as the sandwich ELISA, an antibody adhered to the bottom of a well provides capturing antigen capability and immune specificity, and a different antibody provides detection and amplification. The method described has been cited as an accurate and sensitive reading of the cytokine of interest [16-19]. However, the data reading outcome depends on the kit manufacturer, antibody quality, and skill and experience of the operator [14]. On the other hand, the ELISA method provides some limitations. For example, only one cytokine at a time can be measured, limiting the ability of investigators to analyze various cytokines of interest due to limited amount of biological sample available [9,19]. Moreover, ELISA limits the range of cytokine detection, meaning the linear relationship between cytokine concentration and absorbance reading is narrow compared to other technologies such as multiplex arrays.
ELISA samples above the cytokine range require an additional kit for re-testing with a dilution factor creating additional labor, cost, and valuable sample volume, if extra sample is available. Diluted ELISA values may not be comparable to undiluted ELISA values. This is applicable to serum samples when interpreting the differences in ELISA results between samples that show results within the cytokine range (not requiring dilution) and samples above the cytokine range (requiring dilution) [19]. Multiplex array technologies are increasing in popularity; this is likely due to their ability to simultaneously analyze large numbers of cytokines from a single sample with low volume compared to ELISA [9]. This technology is a flow cytometric (bead-based) assay that allows each bead to be coated with a specific capture antibody. Detection antibodies labeled with a fluorescence compound bind to the specific cytokine-capture antibody complex on each bead. As a result, many cytokines in a biological sample can be detected by the difference in bead fluorescence for nearly 100 biomarkers [19].
When compared to ELISA, multiplex arrays offer these advantages: a) high throughput multiplex analysis, b) reduced sample volume, c) time and cost efficiency, d) ability to evaluate the levels of one given inflammatory biomarker in the context of multiple others, e) ability to perform repeated measures of the same cytokine panels in the same subjects under the same experimental assay conditions, f) ability to reliably detect different proteins across a broad dynamic range of concentrations [19]. The technology of choice is under the discretion of the investigators and depends on the research objective and the biological sample of concern. The comparison between ELISA and Multiplex arrays are acceptable when using tissue culture supernatant samples; however, the comparability is less promising when using serum or plasma samples [13]. Multiplex array technologies are more sensitive than ELISA to alterations in circulating proteins and inhibitors present in serum or plasma, which can complicate levels detected during disease, aging, or inflammatory conditions associated with exercise/sport. IL-1β, IL-6, and TNF-α were selected as the biomarkers of interest to assess the degree of inflammation and muscle damage of professional American football players throughout a season.
These biomarkers have been evaluated and monitored in other sports to determine recovery and inflammation in athletes [1,8,11,12]. Few studies have directly compared serum cytokine results from ELISA and Multiplex analytical techniques, specifically within healthy professional American football players. Therefore, the purpose of this study was to determine differences in serum cytokine concentrations between ELISA and Multiplex techniques.
Materials and Methods
Study Population and Samples
Blood samples were collected in Becton Dickinson (Franklin Lakes, NJ) vacutainers, according to International Review Board (Sterling IRB, Atlanta, GA) approval and the subject’s signed informed consent. Samples came from the antecubital vein of healthy professional American football players during a competitive season. After collection, the whole blood remained at room temperature for 30 minutes to allow samples to coagulate per the vacutainer instructions. After coagulation, the blood was centrifuged, and three 300μL aliquots of serum were frozen at -80°C. To standardize the process, one technician carried out the respective assay protocols on the same day, under the same laboratory conditions, using the exact same serum samples to compare their results across Multiplex and ELISA cytokine kits.
Determination of Cytokines
ELISA Assay: Human IL-1β and Human IL-6 were measured using a competitive ELISA (Millipore Sigma, Sigma Aldrich), an in vitro quantitative assay kit used to detect biological peptides or proteins based on the competitive enzymes immunoassay principle. TNF-α was measured with a high sensitivity amplification ELISA (Invitrogen, Thermo Fisher Scientific). All ELISA assays were performed according to the manufacturer’s instructions. 100μL of serum, in duplicate, were added to the microplates and incubated for 2.5 hours and washed 4x with wash buffer for all ELISA assays. For IL-1β and IL-6, the microplates used were pre-coated with a target-specific antibody (anti-IgG). The antibody was competitively bound by a mixture of biotinylated peptide (provided with the kit) and the endogenous peptide in the serum samples and incubated for 1 hour and washed 4x with wash buffer. The biotinylated peptide then interacted with HRP-Streptavidin and incubated for 45 minutes followed by a 4x wash. Finally, TMB Reagent was added to each well and incubated for 30 min which produced a colorimetric signal to be read on a spectrophotometer.
For TNF-α, each plate was coated with an anti-human TNF-α polyclonal antibody adsorbed onto the microwells. To the microwells, biotin-conjugated anti-human TNF-α antibody was added to attach to any detectable human TNF-α captured by the first antibody. Following a 2-hour incubation, unbound biotinconjugated anti-human TNF-α antibody was removed with an automatic plate washer. After the unbound antibody was removed, Streptavidin-HRP was added and bound to the biotin-conjugated anti-human TNF-α antibody. Following an hour incubation, unbound Streptavidin-HRP was removed during the washing step, and amplification reagent I (Biotinyl-Tyramide) was added to the wells. After a 15-minute incubation, unbound amplification reagent I was removed through washing, and amplification reagent II (Streptavidin-HRP) was added. Following a 30-minute incubation, unbound amplification reagent II was removed by washing, and a substrate solution reactive with HRP, TMB substrate, was added and incubated for 20-minutes.
In the last step, a colored product formed in proportion to the amount of human TNF-α present in the serum or standard. For all ELISA assays, the reactions were terminated with the addition of acid. The sample absorbance was measured at 450nm using a spectrophotometer; the signal intensity was directly proportional to the amount of biotinylated peptide-streptavidin-HRP and inversely proportional to the amount of target peptide in the samples or standards. A standard curve was prepared from seven standard dilutions (IL-6= 1.37-1,000 pg/mL, IL-1β= 0.48-100 pg/ mL, and TNF-α= 0.31-20 pg/mL) and serum sample concentrations were determined using Biotek Cytation 3 Multi-Reader (Biotek, Winooski, VT) with Gen5 software.
Multiplex Assay: IL-1β, IL-6, and TNF-α were simultaneously measured using magnetic bead-based immunoassay Multiplex for comparisons to ELISA techniques. The Multiplex assay was performed according to the manufacturer’s instructions. 25μL of serum sample, in duplicate, were assayed. The Multiplex assay involved beads of defined spectral properties conjugated to proteinspecific capture antibodies and added with the samples (including standards of known protein concentration and control and test samples) into the wells of a microplate. The target proteins bound to the capture antibodies for an overnight incubation. After manual washing of the beads using a magnetic plate, protein-specific biotinylated detector antibodies were added and incubated with the beads for 1-hour. Then, excess biotinylated detector antibodies were removed, and a streptavidin-conjugated fluorescent protein, R-phycoerythrin (SAV-RPE), was added and incubated for 30 minutes. SAV-RPE bound to the biotinylated detector antibodies, forming a four-member, solid-phase sandwich.
After washing to remove unbound SAV-RPE, the beads were analyzed, and standard curves (IL-6= 0.18-750 pg/mL, IL-1β= 0.49- 2000 pg/mL, and TNF-α= 0.43-1750 pg/mL) along with individual well concentrations were determined using the Magpix multiplex system with xPonent software (Luminex, Austin, TX).
Statistics
Coefficients of variation (CV%), paired-samples t-test with 95% CI, and Pearson’s product-moment correlations were used to compare cytokine analysis techniques, similar to other studies investigating differences between competing methods [4,7]. Descriptive statistics are shown as mean ± SD. Statistical analyses were performed using Minitab software (Minitab Inc., State College, PA).
Results
Serum cytokine concentrations were not comparable between ELISA and Multiplex analytical techniques. ELISA kits did not include internal quality controls. All standard curves performed as expected for each assay (r2 >0.99). Descriptive statistical comparison between ELISA and Magpix multiplex for IL-1β (n=15) displayed significant variability between techniques with a CV% of 119.9 (Table 1). IL-6 (n=33) demonstrated substantial variability between techniques with a CV% of 126.9 (Table 2). For TNF-α (n=36) all ELISA samples were below the detection limit of 0.31 pg/mL with the Magpix Multiplex detecting 8.8 ± 3.2 pg/ mL (intra-assay CV%= 7.9). Due to limited sample availability not all serum samples were able to be performed across all kits. Additionally, due to no detection of TNF-α from the ELISA kit, no statistical comparison could be determined between ELSIA and Multiplex. Paired samples t-tests showed considerable mean differences between analytical techniques for IL-1β and IL-6 (Table 3). Pearson correlation coefficients between ELISA and Multiplex were not significant for IL-1β [r(13) = 0.44, p = 0.068] or IL-6 [r(31) = 0.25, p = 0.157] (seen in Figures 1&2).
Discussion
Cytokines are secreted to combat inflammation and are necessary to respond to invading pathogens. Cytokine measurement and detection in serum are essential for immune health, and the ELISA technique has long been the gold standard for analyzing cytokines in serum [14]. However, with advances in biochemical capabilities and technology, multiplex arrays offer quantitative measurement of multiple cytokines to compare to, from a single sample, unlike ELISA. The comparability has yet to be revealed for quantitative serum cytokine analyses with these two methods. Therefore, we sought to determine the differences in serum cytokine concentrations between ELISA and Multiplex techniques. The results presented in this study demonstrate the importance of understanding the limitations and discrepancies between competing analytical methods when designing, conducting, and interpreting research conclusions that involve serum cytokines. ELISA is limited to the measurement of one cytokine at a time, which restricts the ability to measure multiple biomarkers from a single biological sample [9,19].
This restriction can influence an investigator’s ability to answer research questions based on the sample amount available, which was the case in this observational experiment. When samples are above the cytokine range, they are typically diluted and need to be re-analyzed using another assay kit. Dilutions and remeasurements can only occur if there is sample remaining and a diluted sample may reduce the cytokine concentration and diminish any circulating inhibitors or binding protein concentrations [19]. Additionally, freeze-thaw cycles, which are common in multiple ELISAs, may also affect cytokine concentrations. Most cytokines keep their stability for up to 2 years at -80° C, and cytokines such as IL-1β and IL-6 are degraded up to 50% within 2-3 years of storage [2]. Three freezethaw cycles are enough for most cytokines to keep stable [17] however, cytokines such as TNF-α may increase in concentration after each freeze-thaw period showing significant increases after three cycles [6].
ELISA techniques also lack accuracy due to insufficient blocking of immobilized antigen, specifically the hydrophobic binding of immunoglobulin in sample specimens to plastic surfaces. Research has revealed the importance of eliminating any non-specific binding in an immunological assay to avoid false positives and negative results using heterophilic blocking reagents [3,11-18]. Unfortunately, assay manufacturers do not disclose the components of their blocking agents due to proprietary information. The multiplex assay used in this study contained heterophilic blocking agents, per the manufacturer, but no further information could be given. Per our request, the manufacturers of the ELISA kits did not have any information available on their blocking agents. ELISA lacks a dynamic detection range, can be labor-intensive, expensive, and time consuming compared to Multiplex. Multiplex methodology allows for the simultaneous detection of up to 100 biomarkers from a single low volume sample, which saves time and cost.
Multiplex has the capability to perform repeated measurements of the same biomarkers from the same subjects under the same experimental assay conditions as well as the ability to reliably detect multiple biomarkers across a broad range of concentrations. Multiplex assays involve interactions between multiple cytokines in the assay solution, as a result, cross-reactivity may occur [19]. Complications may happen when rare biomarkers are assayed together. Proteins in the serum may also affect the results considering that all multiplex arrays occur in a solution containing freely moving molecules and antigens [19] which is an indicator that multiplex arrays are more sensitive than ELISAs to circulating proteins and inhibitors. While our research suggests that the multiplex and ELISA methods may not be comparable, additional research is warranted across a broader population due to this studies specific and small sample size with healthy and young American football players.
Athletes exhibit fewer changes in cytokine levels following a longer duration of exercise than non-athletes, suggesting that athletes have a reduced cytokine response [8]. A lack of dynamic cytokine range from our subjects is a significant limitation of our work. Additionally, more research is needed to determine the cause of these large discrepancies seen between ELISA and Multiplex methods from the exact same serum samples. The development of universal guidelines and standards to qualify an ELISA or Multiplex assay as certified for research and review by an independent organization, like the National Institute of Standards and Technology, will increase the reliability and comparability of different analytical assays conducted across multiple research outlets. A certified approval on assay kits would provide validity on research conclusions, speed up research opportunities, and increase collaboration across groups due to the validated confidence in assay performance and outcomes.
Conclusion
Navigating the research outcomes across multiple publications has become increasingly difficult for the scientific community to entrust and advance their work due to the lack of comparability across assay kits [15]. The research conclusions from this study confirm those concerns. ELISA has been described as the gold standard for serum cytokine analysis, as well as several other biomarkers. However, the findings from this study advocate further research to determine the source of discrepancies between assay techniques, there is a need for transparency on the types of blocking agents used, as well as the development of validation guidelines which would allow researchers the ability to compare results across multiple techniques and assay manufacturers. The creation of standardized assay guidelines would enhance the interpretation and translation of biomarker research.
Limitations of this study include small sample size, healthy and unique subject population, lack of manufacturer provided controls for the ELISA assays, lack of reference samples analyzed across kits, and the inability to match blocking agents across techniques. Conflict of Interest: This study was funded by and the authors are employed by the Gatorade Sports Science Institute, a division of PepsiCo, Inc. The views expressed in this manuscript are those of the authors and do not necessarily reflect the position or policy of PepsiCo, Inc.
References
- Bernecker C, Scherr J, Schinner S, Braun S, Scherbaum WA, et al. (2013) Evidence for an exercise induced increase of TNF-α and IL-6 in marathon runners. Scandanavian Journal of Medicine and Science in Sports 23(2): 207-214.
- de Jager W, Bourcier K, Rijkers GT, Prakken BJ, Seyfert-Margolis V (2009) Prerequisites for cytokine measurements in clinical trials with multiplex immunoassays. BMC Immunology 10(52).
- DeForge LE, Loyet KM, Delarosa D, Michael J Townsend, Jianyong Wang, et al. (2010) Evaluation of heterophilic antibody blocking agents in reducing false positive interference in immunoassays for IL-17AA, IL-17FF, and IL-17AF. Journal of Immunological Methods 362(1-2): 70-81.
- duPont NC, Wang K, Wadhwa PD, Culhane JF, Nelson EL (2005) Validation and comparison of luminex multiplex cytokine analysis kits with ELISA: Determinations of a panel of nine cytokines in clinical sample culture supernatants. Journal of Reproductive Immunology 66(2): 175-191.
- Elshal MF, McCoy JP (2006) Multiplex bead array assays: Performance evaluation and comparison of sensitivity to ELISA. Methods 38(4): 317-323.
- Flower L, Ahuja RH, Humphries SE, Mohamed-Ali V (2000) Effects of sample handling on the stability of interleukin 6, tumornecrosis factor-α and leptin. Cytokine 12(11): 1712-1716.
- Friasa MA, Virzia J, Batucac J (2019) ELISA methods comparison for the detection of auto-antibodies against apolipoprotein A1. Journal of Immunological Methods 469: 33-41.
- Gokhale R, Chandrashekara S, Vasanthakumar KC (2007) Cytokine response to strenuous exercise in athletes and non-athletes--an adaptive response. Cytokine 40(2): 123-127.
- Leng SX, McElhaney JE, Walston JD, Xie D, Fedarko NS, et al. (2008) ELISA and multiplex technologies for cytokine measurement in inflammation and aging research. The journals of gerontology. Series A, Biological sciences and medical sciences 63(8): 879-884.
- Martins TB, Pasi BM, Litwin CM, Hill HR (2004) Heterophile antibody interference in a multiplexed fluorescent microsphere immunoassay for quantitation of cytokines in human serum. Clinical and Diagnostic Laboratory Immunology 11(2): 325-359.
- Mohr M, Draganidis D, Chatzinikolaou A (2016) Muscle damage, inflammatory, immune and performance responses to three football games in 1 week in competitive male players. European journal of applied physiology 116(1): 179-193.
- Plunkett BA, Callister R, Watson TA, Garg ML (2010) Dietary antioxidant restriction affects the inflammatory response in athletes. British Journal of Nutrition 103(8).
- Prabhakar U, Eirikis E, Reddy M, Hugh M Davis, Bruce E Miller, et al. (2004) Validation and comparative analysis of a multiplexed assayfor the simultaneous quantitative measurement of Th1/Th2cytokines in human serum and human peripheral bloodmononuclear cell culture supernatants. Journal of Immunological Methods 291(1-2): 27-38.
- Stefura WP, Campbell JD, Douville R (2008) Ultrasensitive ELISA for measurement of human cytokine responses in primary culture. In: MG Jones, P Lympany editors. Allergy Methods and Protocols. Methods in Molecular Medicine: Humana Press pp. 107-119.
- Terato K, Do C, Chang J, Waritani T (2016) Preventing further misuse of the ELISA technique and misinterpretation of serological antibody assay data. Vaccine 34(39): 4643-4644.
- Terato K, Doa CT, Cutler D, Waritania T, Shionoyab H (2014) Preventing intense false positive and negative reactions attributed to the principle of ELISA to re-investigate antibody studies in autoimmune diseases. Journal of Immunological Methods 407: 15-25.
- Thavasu PW, Longhurst S, Joel SP, Slevin ML, Balkwill FR (1992) Measuring cytokine levels in blood Importance of anticoagulants, processing, and storage conditions Journal of Immunological Methods 153(1-2): 115-124.
- Waritani T, Chang J, McKinney B, Terato K (2017) An ELISA protocol to improve the accuracy and reliability of serological antibody assays. MethodsX 4: 153-165.
- Zhou K, Fragala MS, McElhaney JE, Kuchel GA (2010) Conceptual and methodological issues relevant to cytokine and inflammatory marker measurements in clinical research. Current opinion in clinical nutrition and metabolic care 13(5): 541-547.