info@biomedres.us   +1 (720) 414-3554
  One Westbrook Corporate Center, Suite 300, Westchester, IL 60154, USA

Biomedical Journal of Scientific & Technical Research

December, 2020, Volume 32, 5, pp 25325-25330

Research Article

Research Article

Comparative Analysis of Serum Cytokine ELISA and Multiplex Techniques

Corey T Ungaro1*, Anthony S Wolfe2 and Shyretha D Brown1

Author Affiliations

1Gatorade Sports Science Institute, PepsiCo R&D Life Sciences, Barrington IL, USA

2Gatorade Sports Science Institute, PepsiCo R&D Life Sciences, Frisco TX, USA

Received: December 17, 2020 | Published: December 23, 2020

Corresponding author: Corey T Ungaro, Gatorade Sports Science Institute, PepsiCo R&D Life Sciences, Barrington IL, USA

DOI: 10.26717/BJSTR.2020.32.005313

Abstract

Enzyme-linked immunosorbent assay (ELISA) has been described as the gold standard for serum cytokine analysis. However, multiplex array technologies are increasing in popularity, likely because of their ability to analyze large numbers of analytes with low sample volume compared to ELISA. Few studies have directly compared serum cytokine results from ELISA and Multiplex analytical techniques. Therefore, the purpose of this observational research was to determine if differences exist in serum cytokine concentrations between ELISA and Multiplex techniques. Blood samples were collected from the antecubital vein of professional American football players during a competitive season to monitor biomarkers fluctuations throughout the season. After clotting, blood was centrifuged and three 300 μL aliquots of serum were frozen at -80°C. IL-1β, IL-6, and TNF-α were measured from the exact same serum samples using ELISA (EMD Millipore, Sigma Aldrich) and Multiplex (EMD Millipore, Magpix) kits.

Coefficients of variation (CV%), paired samples t-test with 95% CI, and Pearson’s product-moment correlations were used to compare cytokine analysis techniques. Descriptive statistics are shown as mean ± SD. Results indicated that serum cytokine concentrations were not comparable between ELISA and Multiplex analytical techniques. IL-1β (n=15) displayed significant variability between techniques with a CV% of 119.9 with ELISA reading 36.8 ± 32.4 pg/mL, intra-assay CV%= 7.6 and Multiplex showing 1.1 ± 1.2 pg/mL, intra-assay CV%= 6.8. IL-6 (n=33) demonstrated substantial variability between techniques with a CV% of 126.9 with ELISA reading 340.2 ± 460.5 pg/mL, intraassay CV%= 15.3 and Multiplex showing 11.8 ± 20.2 pg/mL, intra-assay CV%= 4.8. For TNF-α (n=36) all ELISA samples were below the detection limit of 0.31 with the Multiplex detecting 8.8±3.2 pg/mL, intra-assay CV%= 7.9. Moreover, paired samples t-tests showed considerable mean differences between analysis techniques for IL-1β (-35.8 pg/mL, (95% CI, -51.6 to -19.9) t(17) = -4.8, p < 0.001) and IL-6 (-328.4 pg/mL (95% CI,-490.0 to -166.7), t(32)= -4.1, p < 0.001.

Pearson’s correlation between ELISA and Multiplex was not significant for IL-1β [r(13) = 0.44, p = 0.068] or IL-6 [r(31) = 0.25, p = 0.157]. The results suggest that ELISA and Multiplex outcomes were not comparable and the differences in blocking agents used may be the source of erraticism. According to the results from this study, comparisons between analytical techniques should be avoided and more work is needed to determine the cause of these large discrepancies seen between methods.

Introduction

Inflammation is a protective response that is necessary for responding to invading pathogens. Cytokines, secreted by immune cells, play a major role in this response. Measurement and detection of cytokine levels in serum are essential in understanding biological homeostasis to maintain human health. Investigation of cytokines in serum analysis has been classically conducted by enzyme-linked immunosorbent assay (ELISA). With an increasing demand for rapid and precise measurements for multiple cytokines and other biomarkers, ELISA has been the standard for quantitative serum analysis. Yet, it is not well suited for high throughput multiple biomarker detection [5]. Compared to ELISA, multiplex arrays provide quantitative measurement of multiple cytokines on a largescale using bead-based technology. This sought-after assay offers a quantitative measure of multiple cytokines on a large-scale using bead-based technology. Thus, further analysis of these two methods for quantitative serum cytokine analyses is necessary.

ELISA has been classically described as the gold standard for serum cytokine analysis [14]. Also known as the sandwich ELISA, an antibody adhered to the bottom of a well provides capturing antigen capability and immune specificity, and a different antibody provides detection and amplification. The method described has been cited as an accurate and sensitive reading of the cytokine of interest [16-19]. However, the data reading outcome depends on the kit manufacturer, antibody quality, and skill and experience of the operator [14]. On the other hand, the ELISA method provides some limitations. For example, only one cytokine at a time can be measured, limiting the ability of investigators to analyze various cytokines of interest due to limited amount of biological sample available [9,19]. Moreover, ELISA limits the range of cytokine detection, meaning the linear relationship between cytokine concentration and absorbance reading is narrow compared to other technologies such as multiplex arrays.

ELISA samples above the cytokine range require an additional kit for re-testing with a dilution factor creating additional labor, cost, and valuable sample volume, if extra sample is available. Diluted ELISA values may not be comparable to undiluted ELISA values. This is applicable to serum samples when interpreting the differences in ELISA results between samples that show results within the cytokine range (not requiring dilution) and samples above the cytokine range (requiring dilution) [19]. Multiplex array technologies are increasing in popularity; this is likely due to their ability to simultaneously analyze large numbers of cytokines from a single sample with low volume compared to ELISA [9]. This technology is a flow cytometric (bead-based) assay that allows each bead to be coated with a specific capture antibody. Detection antibodies labeled with a fluorescence compound bind to the specific cytokine-capture antibody complex on each bead. As a result, many cytokines in a biological sample can be detected by the difference in bead fluorescence for nearly 100 biomarkers [19].

When compared to ELISA, multiplex arrays offer these advantages: a) high throughput multiplex analysis, b) reduced sample volume, c) time and cost efficiency, d) ability to evaluate the levels of one given inflammatory biomarker in the context of multiple others, e) ability to perform repeated measures of the same cytokine panels in the same subjects under the same experimental assay conditions, f) ability to reliably detect different proteins across a broad dynamic range of concentrations [19]. The technology of choice is under the discretion of the investigators and depends on the research objective and the biological sample of concern. The comparison between ELISA and Multiplex arrays are acceptable when using tissue culture supernatant samples; however, the comparability is less promising when using serum or plasma samples [13]. Multiplex array technologies are more sensitive than ELISA to alterations in circulating proteins and inhibitors present in serum or plasma, which can complicate levels detected during disease, aging, or inflammatory conditions associated with exercise/sport. IL-1β, IL-6, and TNF-α were selected as the biomarkers of interest to assess the degree of inflammation and muscle damage of professional American football players throughout a season.

These biomarkers have been evaluated and monitored in other sports to determine recovery and inflammation in athletes [1,8,11,12]. Few studies have directly compared serum cytokine results from ELISA and Multiplex analytical techniques, specifically within healthy professional American football players. Therefore, the purpose of this study was to determine differences in serum cytokine concentrations between ELISA and Multiplex techniques.

Materials and Methods

Study Population and Samples

Blood samples were collected in Becton Dickinson (Franklin Lakes, NJ) vacutainers, according to International Review Board (Sterling IRB, Atlanta, GA) approval and the subject’s signed informed consent. Samples came from the antecubital vein of healthy professional American football players during a competitive season. After collection, the whole blood remained at room temperature for 30 minutes to allow samples to coagulate per the vacutainer instructions. After coagulation, the blood was centrifuged, and three 300μL aliquots of serum were frozen at -80°C. To standardize the process, one technician carried out the respective assay protocols on the same day, under the same laboratory conditions, using the exact same serum samples to compare their results across Multiplex and ELISA cytokine kits.

Determination of Cytokines

ELISA Assay: Human IL-1β and Human IL-6 were measured using a competitive ELISA (Millipore Sigma, Sigma Aldrich), an in vitro quantitative assay kit used to detect biological peptides or proteins based on the competitive enzymes immunoassay principle. TNF-α was measured with a high sensitivity amplification ELISA (Invitrogen, Thermo Fisher Scientific). All ELISA assays were performed according to the manufacturer’s instructions. 100μL of serum, in duplicate, were added to the microplates and incubated for 2.5 hours and washed 4x with wash buffer for all ELISA assays. For IL-1β and IL-6, the microplates used were pre-coated with a target-specific antibody (anti-IgG). The antibody was competitively bound by a mixture of biotinylated peptide (provided with the kit) and the endogenous peptide in the serum samples and incubated for 1 hour and washed 4x with wash buffer. The biotinylated peptide then interacted with HRP-Streptavidin and incubated for 45 minutes followed by a 4x wash. Finally, TMB Reagent was added to each well and incubated for 30 min which produced a colorimetric signal to be read on a spectrophotometer.

For TNF-α, each plate was coated with an anti-human TNF-α polyclonal antibody adsorbed onto the microwells. To the microwells, biotin-conjugated anti-human TNF-α antibody was added to attach to any detectable human TNF-α captured by the first antibody. Following a 2-hour incubation, unbound biotinconjugated anti-human TNF-α antibody was removed with an automatic plate washer. After the unbound antibody was removed, Streptavidin-HRP was added and bound to the biotin-conjugated anti-human TNF-α antibody. Following an hour incubation, unbound Streptavidin-HRP was removed during the washing step, and amplification reagent I (Biotinyl-Tyramide) was added to the wells. After a 15-minute incubation, unbound amplification reagent I was removed through washing, and amplification reagent II (Streptavidin-HRP) was added. Following a 30-minute incubation, unbound amplification reagent II was removed by washing, and a substrate solution reactive with HRP, TMB substrate, was added and incubated for 20-minutes.

In the last step, a colored product formed in proportion to the amount of human TNF-α present in the serum or standard. For all ELISA assays, the reactions were terminated with the addition of acid. The sample absorbance was measured at 450nm using a spectrophotometer; the signal intensity was directly proportional to the amount of biotinylated peptide-streptavidin-HRP and inversely proportional to the amount of target peptide in the samples or standards. A standard curve was prepared from seven standard dilutions (IL-6= 1.37-1,000 pg/mL, IL-1β= 0.48-100 pg/ mL, and TNF-α= 0.31-20 pg/mL) and serum sample concentrations were determined using Biotek Cytation 3 Multi-Reader (Biotek, Winooski, VT) with Gen5 software.

Multiplex Assay: IL-1β, IL-6, and TNF-α were simultaneously measured using magnetic bead-based immunoassay Multiplex for comparisons to ELISA techniques. The Multiplex assay was performed according to the manufacturer’s instructions. 25μL of serum sample, in duplicate, were assayed. The Multiplex assay involved beads of defined spectral properties conjugated to proteinspecific capture antibodies and added with the samples (including standards of known protein concentration and control and test samples) into the wells of a microplate. The target proteins bound to the capture antibodies for an overnight incubation. After manual washing of the beads using a magnetic plate, protein-specific biotinylated detector antibodies were added and incubated with the beads for 1-hour. Then, excess biotinylated detector antibodies were removed, and a streptavidin-conjugated fluorescent protein, R-phycoerythrin (SAV-RPE), was added and incubated for 30 minutes. SAV-RPE bound to the biotinylated detector antibodies, forming a four-member, solid-phase sandwich.

After washing to remove unbound SAV-RPE, the beads were analyzed, and standard curves (IL-6= 0.18-750 pg/mL, IL-1β= 0.49- 2000 pg/mL, and TNF-α= 0.43-1750 pg/mL) along with individual well concentrations were determined using the Magpix multiplex system with xPonent software (Luminex, Austin, TX).

Statistics

Coefficients of variation (CV%), paired-samples t-test with 95% CI, and Pearson’s product-moment correlations were used to compare cytokine analysis techniques, similar to other studies investigating differences between competing methods [4,7]. Descriptive statistics are shown as mean ± SD. Statistical analyses were performed using Minitab software (Minitab Inc., State College, PA).

Results

Serum cytokine concentrations were not comparable between ELISA and Multiplex analytical techniques. ELISA kits did not include internal quality controls. All standard curves performed as expected for each assay (r2 >0.99). Descriptive statistical comparison between ELISA and Magpix multiplex for IL-1β (n=15) displayed significant variability between techniques with a CV% of 119.9 (Table 1). IL-6 (n=33) demonstrated substantial variability between techniques with a CV% of 126.9 (Table 2). For TNF-α (n=36) all ELISA samples were below the detection limit of 0.31 pg/mL with the Magpix Multiplex detecting 8.8 ± 3.2 pg/ mL (intra-assay CV%= 7.9). Due to limited sample availability not all serum samples were able to be performed across all kits. Additionally, due to no detection of TNF-α from the ELISA kit, no statistical comparison could be determined between ELSIA and Multiplex. Paired samples t-tests showed considerable mean differences between analytical techniques for IL-1β and IL-6 (Table 3). Pearson correlation coefficients between ELISA and Multiplex were not significant for IL-1β [r(13) = 0.44, p = 0.068] or IL-6 [r(31) = 0.25, p = 0.157] (seen in Figures 1&2).

Table 1: Comparison between ELISA and Magpix IL-1β.

Table 2: Comparison between ELISA and Magpix IL-6.

Table 3: Paired Samples t-test between ELISA and Magpix IL-1β and IL-6.

Figure 1: Method Comparison.

Note: Data expressed as ELISA IL-1β (pg/mL) vs. Magpix IL-1β (pg/mL) serum concentrations. Standard curve ranges (ELISA 0.48-100 and Magpix 0.49-2000 pg/mL). Limit of detection for ELISA 0.3 pg/mL and Magpix 0.66 pg/mL.

Figure 2: Method Comparison.

Note: Data expressed as ELISA IL-6 (pg/mL) vs. Magpix IL-6 (pg/mL) serum concentrations. Standard curve ranges (ELISA 1.37-1,000 and Magpix 0.18-750 pg/mL). Limit of detection for ELISA 3.0 pg/mL and Magpix 0.18 pg/mL.

Discussion

Cytokines are secreted to combat inflammation and are necessary to respond to invading pathogens. Cytokine measurement and detection in serum are essential for immune health, and the ELISA technique has long been the gold standard for analyzing cytokines in serum [14]. However, with advances in biochemical capabilities and technology, multiplex arrays offer quantitative measurement of multiple cytokines to compare to, from a single sample, unlike ELISA. The comparability has yet to be revealed for quantitative serum cytokine analyses with these two methods. Therefore, we sought to determine the differences in serum cytokine concentrations between ELISA and Multiplex techniques. The results presented in this study demonstrate the importance of understanding the limitations and discrepancies between competing analytical methods when designing, conducting, and interpreting research conclusions that involve serum cytokines. ELISA is limited to the measurement of one cytokine at a time, which restricts the ability to measure multiple biomarkers from a single biological sample [9,19].

This restriction can influence an investigator’s ability to answer research questions based on the sample amount available, which was the case in this observational experiment. When samples are above the cytokine range, they are typically diluted and need to be re-analyzed using another assay kit. Dilutions and remeasurements can only occur if there is sample remaining and a diluted sample may reduce the cytokine concentration and diminish any circulating inhibitors or binding protein concentrations [19]. Additionally, freeze-thaw cycles, which are common in multiple ELISAs, may also affect cytokine concentrations. Most cytokines keep their stability for up to 2 years at -80° C, and cytokines such as IL-1β and IL-6 are degraded up to 50% within 2-3 years of storage [2]. Three freezethaw cycles are enough for most cytokines to keep stable [17] however, cytokines such as TNF-α may increase in concentration after each freeze-thaw period showing significant increases after three cycles [6].

ELISA techniques also lack accuracy due to insufficient blocking of immobilized antigen, specifically the hydrophobic binding of immunoglobulin in sample specimens to plastic surfaces. Research has revealed the importance of eliminating any non-specific binding in an immunological assay to avoid false positives and negative results using heterophilic blocking reagents [3,11-18]. Unfortunately, assay manufacturers do not disclose the components of their blocking agents due to proprietary information. The multiplex assay used in this study contained heterophilic blocking agents, per the manufacturer, but no further information could be given. Per our request, the manufacturers of the ELISA kits did not have any information available on their blocking agents. ELISA lacks a dynamic detection range, can be labor-intensive, expensive, and time consuming compared to Multiplex. Multiplex methodology allows for the simultaneous detection of up to 100 biomarkers from a single low volume sample, which saves time and cost.

Multiplex has the capability to perform repeated measurements of the same biomarkers from the same subjects under the same experimental assay conditions as well as the ability to reliably detect multiple biomarkers across a broad range of concentrations. Multiplex assays involve interactions between multiple cytokines in the assay solution, as a result, cross-reactivity may occur [19]. Complications may happen when rare biomarkers are assayed together. Proteins in the serum may also affect the results considering that all multiplex arrays occur in a solution containing freely moving molecules and antigens [19] which is an indicator that multiplex arrays are more sensitive than ELISAs to circulating proteins and inhibitors. While our research suggests that the multiplex and ELISA methods may not be comparable, additional research is warranted across a broader population due to this studies specific and small sample size with healthy and young American football players.

Athletes exhibit fewer changes in cytokine levels following a longer duration of exercise than non-athletes, suggesting that athletes have a reduced cytokine response [8]. A lack of dynamic cytokine range from our subjects is a significant limitation of our work. Additionally, more research is needed to determine the cause of these large discrepancies seen between ELISA and Multiplex methods from the exact same serum samples. The development of universal guidelines and standards to qualify an ELISA or Multiplex assay as certified for research and review by an independent organization, like the National Institute of Standards and Technology, will increase the reliability and comparability of different analytical assays conducted across multiple research outlets. A certified approval on assay kits would provide validity on research conclusions, speed up research opportunities, and increase collaboration across groups due to the validated confidence in assay performance and outcomes.

Conclusion

Navigating the research outcomes across multiple publications has become increasingly difficult for the scientific community to entrust and advance their work due to the lack of comparability across assay kits [15]. The research conclusions from this study confirm those concerns. ELISA has been described as the gold standard for serum cytokine analysis, as well as several other biomarkers. However, the findings from this study advocate further research to determine the source of discrepancies between assay techniques, there is a need for transparency on the types of blocking agents used, as well as the development of validation guidelines which would allow researchers the ability to compare results across multiple techniques and assay manufacturers. The creation of standardized assay guidelines would enhance the interpretation and translation of biomarker research.

Limitations of this study include small sample size, healthy and unique subject population, lack of manufacturer provided controls for the ELISA assays, lack of reference samples analyzed across kits, and the inability to match blocking agents across techniques. Conflict of Interest: This study was funded by and the authors are employed by the Gatorade Sports Science Institute, a division of PepsiCo, Inc. The views expressed in this manuscript are those of the authors and do not necessarily reflect the position or policy of PepsiCo, Inc.

References

Research Article

Comparative Analysis of Serum Cytokine ELISA and Multiplex Techniques

Corey T Ungaro1*, Anthony S Wolfe2 and Shyretha D Brown1

Author Affiliations

1Gatorade Sports Science Institute, PepsiCo R&D Life Sciences, Barrington IL, USA

2Gatorade Sports Science Institute, PepsiCo R&D Life Sciences, Frisco TX, USA

Received: December 17, 2020 | Published: December 23, 2020

Corresponding author: Corey T Ungaro, Gatorade Sports Science Institute, PepsiCo R&D Life Sciences, Barrington IL, USA

DOI: 10.26717/BJSTR.2020.32.005313

Abstract

Enzyme-linked immunosorbent assay (ELISA) has been described as the gold standard for serum cytokine analysis. However, multiplex array technologies are increasing in popularity, likely because of their ability to analyze large numbers of analytes with low sample volume compared to ELISA. Few studies have directly compared serum cytokine results from ELISA and Multiplex analytical techniques. Therefore, the purpose of this observational research was to determine if differences exist in serum cytokine concentrations between ELISA and Multiplex techniques. Blood samples were collected from the antecubital vein of professional American football players during a competitive season to monitor biomarkers fluctuations throughout the season. After clotting, blood was centrifuged and three 300 μL aliquots of serum were frozen at -80°C. IL-1β, IL-6, and TNF-α were measured from the exact same serum samples using ELISA (EMD Millipore, Sigma Aldrich) and Multiplex (EMD Millipore, Magpix) kits.

Coefficients of variation (CV%), paired samples t-test with 95% CI, and Pearson’s product-moment correlations were used to compare cytokine analysis techniques. Descriptive statistics are shown as mean ± SD. Results indicated that serum cytokine concentrations were not comparable between ELISA and Multiplex analytical techniques. IL-1β (n=15) displayed significant variability between techniques with a CV% of 119.9 with ELISA reading 36.8 ± 32.4 pg/mL, intra-assay CV%= 7.6 and Multiplex showing 1.1 ± 1.2 pg/mL, intra-assay CV%= 6.8. IL-6 (n=33) demonstrated substantial variability between techniques with a CV% of 126.9 with ELISA reading 340.2 ± 460.5 pg/mL, intraassay CV%= 15.3 and Multiplex showing 11.8 ± 20.2 pg/mL, intra-assay CV%= 4.8. For TNF-α (n=36) all ELISA samples were below the detection limit of 0.31 with the Multiplex detecting 8.8±3.2 pg/mL, intra-assay CV%= 7.9. Moreover, paired samples t-tests showed considerable mean differences between analysis techniques for IL-1β (-35.8 pg/mL, (95% CI, -51.6 to -19.9) t(17) = -4.8, p < 0.001) and IL-6 (-328.4 pg/mL (95% CI,-490.0 to -166.7), t(32)= -4.1, p < 0.001.

Pearson’s correlation between ELISA and Multiplex was not significant for IL-1β [r(13) = 0.44, p = 0.068] or IL-6 [r(31) = 0.25, p = 0.157]. The results suggest that ELISA and Multiplex outcomes were not comparable and the differences in blocking agents used may be the source of erraticism. According to the results from this study, comparisons between analytical techniques should be avoided and more work is needed to determine the cause of these large discrepancies seen between methods.