Electronic On-Ramp, Inc. v. United States

In the United States Court of Federal Claims

(Bid Protest)

No. 14-1038C

(Filed Under Seal: March 18, 2015 | Reissued: March 30, 2015)*

)

THE ELECTRONIC ON-RAMP, INC., )

)

Plaintiff, ) Post-award bid protest; Best-Value

) Procurement; FAR Part 15; Deficiency;

v. ) FAR 15.001.

)

THE UNITED STATES OF AMERICA, )

)

Defendant, )

and )

)

PREMIER MANAGEMENT )

CORPORATION, )

Defendant-Intervenor. )

)

William Thomas Welch, McMahon, Welch & Learned, Reston, VA, for plaintiff.

Barbara E. Thomas, Commercial Litigation Branch, Civil Division, United States

Department of Justice, Washington D.C., for defendant. With her on the briefs

were Robert M. Norway, Martin F. Hockey, Jr., Robert E. Kirschman, Jr., and

Joyce R. Branda of the Department of Justice and Of Counsel, Warren M. Rose of

the Air Force Legal Operations Agency.

Heather A. James, Whiteford, Taylor and Preston, LLP, Washington, D.C., for

defendant-intervenor.

OPINION AND ORDER

KAPLAN, Judge.

In this post-award bid protest, Plaintiff Electronic On-Ramp, Inc. (“EOR”) challenges the

Air Force’s award of a contract for linguist and analyst support services to defendant-intervenor

Premier Management Corporation (“Premier”). Currently before the Court are EOR’s motion

for judgment on the administrative record and the government’s cross-motion for judgment on

*

This Opinion was originally issued under seal, and the parties were given the opportunity to

propose redactions by March 27, 2015. Because the Court did not receive any such proposals,

the Court reissues its decision without redactions.

the administrative record. For the reasons set forth below, EOR’s motion is DENIED, and the

government’s cross-motion is GRANTED.

BACKGROUND1

I. The Solicitation

In May 2013, the Air Force Intelligence, Surveillance, and Reconnaissance Agency (“the

agency” or “the government”) issued a solicitation seeking “linguist and analyst support

services,” to be performed during a base and two option years pursuant to task orders issued

under an indefinite delivery, indefinite quantity contract. Administrative Record (“AR”) 10:211,

243.2 The solicitation sought offers only from disadvantaged small businesses, pursuant to the

Small Business Administration’s 8(a) Business Development Program. AR 10:141. The

contract would be awarded to the offeror whose proposal represented the best value to the

government. AR 10:175.

A. Services to be Provided

A “performance work statement,” or PWS, included in the solicitation described the tasks

that the personnel of the successful offeror would be obligated to perform. These tasks included:

translating spoken and written communications into English from various other languages, and

vice versa, sometimes in “near real-time,” AR 10:243-45; analyzing translated communications

for potentially significant intelligence, which would be reported to agency personnel and used to

inform tactical and strategic military decisions, AR 10:245-46; and developing and conducting

training programs to teach agency personnel to translate and analyze specified languages. AR

10:246-48. Work under the contract would be performed at agency facilities in a variety of

locations, including Fort Meade, Maryland; Royal Air Force (RAF) Mildenhall, United

Kingdom; JB Kunia, Hawaii; and Kadena Air Base, Japan, AR 10:243, and would be so time-

sensitive that the contractor would be required to retain 85 percent of the necessary personnel as

of contract award and 100 percent as of 90 days after award. AR 10:178.

The solicitation instructed each potential offeror to submit a proposal consisting of five

volumes, including a technical volume (Volume II), a past and present performance volume

(Volume III), and a price/cost volume (Volume IV). AR 10:166. In the technical volume,

offerors were to address two major subject areas: their technical approach and their management

approach. AR 10:167-68.

1

The background constitutes findings of fact made by the Court from the administrative record

of the procurement filed pursuant to RCFC 52.1(a). See Bannum, Inc. v. United States, 404 F.3d

1346, 1356 (Fed. Cir. 2005) (observing that bid protests “provide for trial on a paper record,

allowing fact-finding by the trial court”).

2

The administrative record is paginated sequentially and also divided into tabs. In citing to the

administrative record, the Court will designate the tab, followed by the page number. For

example, AR 10:211 refers to page 211, which is located in Tab 10.

2

Most pertinent to this case, in connection with the technical approach factor, the agency

requested that offerors provide “five (5) samples of current complete curriculum” for five of the

foreign-language instruction courses conducted by each offeror, “to include lesson plans,

quizzes/progress checks and tests for courses.” AR 10:168. After the issuance of the

solicitation, the agency received the following question: “Would a comprehensive course

syllabus that covers daily lesson plans for the entire course duration, as well as quizzes, test[s],

and student progress be sufficient to meet the sample requirements?” AR 11:317. The agency

clarified that such a syllabus would not satisfy the solicitation’s requirements because the term

“‘curriculum’ refers to the entire course” conducted by the offeror. Id.

After describing the information that offerors were to provide regarding their technical

approach, the solicitation listed a variety of topics related to management approach that offerors

should also discuss in their technical volume. AR 10:168. The agency identified and asked the

offeror to identify transition and execution risks that it considered likely to arise during contract

performance and asked how the offeror would mitigate or address each one. See id. In addition,

each offeror was asked to “[d]escribe your approach for managing personnel resources across

multiple projects at various geographical locations” and for “managing multiple task orders at

various geographical locations.” AR 10:168. The agency also requested “a Staffing Plan that

addresses your acquisition and retention methods for skilled personnel, including retention

during times of limited taskings,” as well as “a Training Plan for skill personnel” that detailed

the contractor’s “process for introducing new personnel to the project” and its method for

“ensur[ing] that the required training will be accomplished and managed.” Id.

B. Evaluation Criteria

The solicitation explained the manner in which the agency would evaluate information

offerors provided in their proposals. AR 10:174-81. The agency would evaluate proposals using

three factors listed here in descending order of importance: technical, past and present

performance, and cost/price. AR 10:175. The technical factor would encompass two subfactors,

technical approach and management approach, of which the former would carry more weight.

AR 10:175-76. In combination, the technical and past and present performance factors would be

“significantly more important than cost or price,” so that award might be made “to a higher rated,

higher priced offeror, where the decision is consistent with the evaluation factors, and the Source

Selection Authority (SSA) reasonably determines that the technical and/or overall business

approach and/or past and present performance of the higher price offeror outweighs the cost

difference.” AR 10:175-76.

In evaluating the technical aspects of offerors’ proposals, the agency would conduct “two

distinct but related assessments,” each having equal weight, with respect to both the technical

approach subfactor and the management approach subfactor: “the [t]echnical [r]ating and the

[t]echnical [r]isk [r]ating.” AR 10:176. The technical rating, expressed by an adjective paired

with a corresponding color, would capture the agency’s determinations regarding the extent to

which a proposal met the Government’s requirements. Id. The highest possible technical rating

of blue/outstanding would be awarded to any proposal that “[met] requirements and indicate[d]

an exceptional [a]pproach and understanding of the requirements”; such a proposal would

“contain multiple strengths and no deficiencies.” Id. The lowest rating of red/unacceptable

3

would be assigned to any proposal that did “not meet requirements[,] . . . contain[ed] one or

more deficiencies,” and was, accordingly, “unawardable.” Id.

Along with the technical rating, the agency would assign each proposal a technical risk

rating, determined based upon “the identification of weakness(es)” that, in the agency’s

estimation, increased the potential “for disruption of schedule, increased costs, . . . degradation of

performance, the need for Government oversight, or the likelihood of unsuccessful contract

performance.” AR 10:176. Possible risk ratings ranged from low, indicating “little potential to

cause disruption of schedule, increased cost or degradation of performance,” to high, indicating a

“likel[ihood] to cause significant disruption of schedule, increased cost, or degradation of

performance” that was “unlikely” to be “overcome . . . , even with special contractor emphasis

and close Government monitoring.” AR 10:176-77.

II. Submission and Initial Evaluation of Proposals

The agency received proposals from nine offerors, including EOR and the ultimate

awardee, Premier. AR 80:9814-15. EOR offered a lower price than any other offeror. Id. In its

initial evaluation of EOR’s technical approach, the agency’s Source Selection Evaluation Board

(SSEB) assigned EOR a red/unacceptable rating because EOR “did not sufficiently demonstrate

understanding/knowledge in some areas and it was deficient in providing current complete

course samples.” AR 33:7192. Specifically, EOR’s proposal was deficient because it did not

provide “samples of quizzes/progress checks or tests” for its five foreign language course

curricula. AR 33:7193.

The SSEB also determined that the proposal included several weaknesses not rising to the

level of deficiencies: EOR “did not show a sufficient understanding of the roles of the assigned

[contractor] personnel within the DoD Intelligence Community . . . and its mission of providing

near to real time intelligence to supported units,” nor did EOR “show sufficient knowledge and

experience” in “[p]rocessing Signals Intelligence (SIGINT),” “[p]roducing written

documentation such as transcripts and reports,” or “implement[ing] . . . training req[uirements]

as related to DCGS, DSO, COMPASS CALL, Airborne/Ground Linguists.” Id. Finally, the

SSEB noted that EOR’s proposal “failed to comply with page limits,” and that the SSEB had

“removed,” and so had not considered, “pages 61 and later” from EOR’s technical volume. Id.

The SSEB identified one strength in EOR’s proposal, approving of EOR’s plan to use “a

rapid prototype approach” to adapt its training courses to changing needs. AR 33:7191-93.

Because of the incompleteness of EOR’s curricula and its “weaknesses in showing

understanding/knowledge of items specified in” the solicitation, the SSEB assessed the risk

associated with the offeror’s technical approach as moderate. AR 33:7193.

As to its management approach, EOR received a technical rating of yellow/marginal and

a technical risk rating of high. AR 33:7193-94. The SSEB noted “several weak areas” in EOR’s

responses to prompts contained in the solicitation. AR 33:7193. First, EOR “did not sufficiently

detail how [it] would deal with transition risks,” including the need to “meet[] Government

staffing requirements for 85% staff at contract award and 100% staff at 90 days.” Id. Second,

EOR did not “show how [it] can sufficiently manage personnel at multi-geographical locations

4

and assigned to multiple tasking orders. AR 33:7193-94. Finally, although EOR’s “management

hierarchy satisfactorily m[et] Government requirements,” “it d[id] not include an acceptable

staffing and training plan for their personnel.” AR 33:7194. Although the SSEB found no

strengths or deficiencies in EOR’s management approach, it concluded that EOR’s “significant

weaknesses . . . increase[d] the risk of unsuccessful contract performance.” Id.

In contrast to EOR, Premier received a technical rating of blue/outstanding and technical

risk rating of low risk for both technical and management approaches. AR 36:7407. Both the

technical approach and the management approach proposed by Premier offered several strengths,

while revealing no weaknesses. AR 34:7197-200. The SSEB assessed Premier’s risk of non-

performance as low. Id. Several other offerors also received technical ratings that, while not as

high as Premier’s, far exceeded EOR’s. AR 36:7407.

On the past and present performance factor, EOR received a rating of limited confidence.

AR 31:7182. EOR identified in its performance volume five contracts performed by either itself

or one of its six proposed subcontractors. AR 18:1315-31. The agency’s past performance

evaluation team evaluated only two of those contracts, however, because EOR’s past

performance volume did not comply with the established page limitations, running fourteen

pages over the ten-page limit. AR 31:7171. See AR 18:1310-1333. Once the excess pages were

removed, the remaining pages described only two contracts, neither of which was considered

relevant by the evaluators. AR 31:7169. Performance reviews obtained by EOR and by the

agency provided little to no information regarding the extent to which EOR had in the past

successfully performed activities similar to those required by the solicitation. AR 31:7181.

The evaluators noted further concerns. EOR’s past performance volume “was of

extremely poor quality” and so “rife with typographical errors, incorrect word usage, fragmented

or incomplete sentence[s]/thoughts[,] and contradictory statements” that evaluators had difficulty

understanding “what was being communicated.” AR 31:7181. The SSEB also noted that the

source selection team “was concerned that EOR’s adversarial attitude (noted in the past

performance binder and CPARS 1) towards current and previous teammates (including the

government)” could adversely impact this contract. AR 31:7181.

After evaluation teams had rated the technical and past performance volumes of all

offerors, the source selection authority (SSA) reviewed those ratings and weighed them against

each other, as well as against each offeror’s price. While the SSA recognized that EOR offered

the lowest price, based upon that weighing process, the SSA ranked Premier’s proposal first,

with ratings on technical and past performance factors as follows:

1. Premier Management (Premier)

Factor 1: Technical Technical Rating Risk Rating

Subfactor 1, Technical Approach: Blue/Outstanding Low Risk

Subfactor 2, Management Approach Blue/Outstanding Low Risk

Factor 2, Past Performance Satisfactory Confidence

AR 36:7407. EOR was ranked seventh out of nine offerors, with ratings on technical and past

performance factors as follows:

5

7. Electronic On-Ramp (EOR)

Factor 1: Technical Technical Rating Risk Rating

Subfactor 1, Technical Approach: Red/Unacceptable Moderate

Risk

Subfactor 2, Management Approach Yellow/Marginal High Risk

Factor 2, Past Performance Limited Confidence

AR 36:7408.

III. Award, Protests, and Corrective Action by Agency

Based upon the SSA’s determination that Premier’s proposal represented the best value to

the government, the agency awarded the contract to Premier on September 20, 2013. AR

40:7588. Shortly thereafter, two unsuccessful offerors lodged protests with the Small Business

Administration (SBA), asserting that Premier did not properly qualify as a business entitled to

participate in the 8(a) program. AR 43:7735-37; 45:7740-57. The SBA rejected these protests.

AR 61:8547, 8549.

While the SBA’s decision was pending, EOR filed a protest before the Government

Accountability Office (GAO). AR 51:8203-54. EOR argued, among other things, that (1) in

evaluating EOR’s sample curricula, the agency failed to notice that sample tests and quizzes had

been submitted for one curriculum, a course in the Tamasheq language, AR 51:8208; (2) the

agency had erroneously excluded from consideration several pages of EOR’s technical proposal

that had fallen within the page limit and treated the presence of the pages as a weakness in its

proposal, AR 51:8214-15; and (3) the two contracts considered by the agency during the past and

present performance evaluation should have been deemed relevant. AR 51:8248-49. EOR

subsequently withdrew its protest after the agency issued a notice announcing that it would take

voluntary corrective action. AR 53:8256. In its notice, the agency stated that it “believes its

evaluation of past performance submissions did not comply with the evaluation scheme stated in

the solicitation,” and that “there were instances in the technical evaluations where documents or

pages within the proposals were not sufficiently evaluated.” AR 52:8255. As a result, the

agency would re-evaluate offerors’ past performance and technical volumes. Id.

In accordance with its corrective action notice, the agency conducted re-evaluations of

offerors’ past and present performance submissions, see AR, Tabs 55, 56, 64, 65, and of EOR’s

technical volume. See AR Tab 54. Upon completion of its re-evaluation of EOR’s past

performance information the agency reaffirmed EOR’s “limited confidence” rating. AR

64:8593-94.

In re-evaluating EOR’s technical information, as pertinent here, the agency re-examined

EOR’s sample curricula and noted that the Tamasheq curriculum does, in fact, contain sample

quizzes. AR 54:8259. Nevertheless, EOR’s technical volume remained “deficient in this area by

not providing samples of quizzes/progress checks or tests for [the other four course samples].”

Id. Furthermore, the SSEB noted that the quizzes included in the Tamasheq course consisted of

two quizzes with “10 questions each,” a third quiz involving only “translat[ion] [of] a song,” and

“a blank progress check sample” with “no actual questions.” Id. The agency considered these

6

sample assessments “very weak.” Overall, EOR’s technical approach ratings remained

unchanged.

After completing this initial re-evaluation of EOR’s technical proposal, the SSEB

conducted a second re-evaluation, considering the arguments advanced by EOR in its protest

before the GAO. AR 77:9331-35. The SSEB determined that none of those arguments justified

a change in EOR’s technical ratings. AR 77:9335. It also deleted its reference to the weakness

of EOR’s Tamasheq quizzes from its explanation of the deficiency of EOR’s proposal, making

clear that the absence of tests and quizzes from the other four curricula, not the weakness of the

Tamasheq assessments, was responsible for the finding of deficiency. AR 77:9336.

After conducting re-evaluations to ensure that all proposals had been submitted precisely

as the solicitation dictated, the SSA’s ultimate ranking of offerors remained the same. AR

80:9814-15.

IV. Award and Second GAO Protest

The agency awarded the contract to Premier on June 17, 2014. AR 81:9842-43. On June

30, 2014, EOR, despite being ranked seventh out of nine offerors, again filed a protest at the

GAO. AR 1:1-50. After EOR failed to timely submit its comments on the agency’s report, the

GAO dismissed the protest on August 14, 2014. AR 89:9986-87.

EOR filed this protest here on October 24, 2014 seeking to permanently enjoin the

agency from proceeding with performance of the contract. EOR contends that the evaluation of

its proposal as well as Premier’s was unreasonable, arbitrary, and unsupported by the written

record. It challenges virtually every rating that the agency assigned to its proposal. Moreover, it

contends that the agency failed to follow through on its promised corrective action upon which

EOR agreed to withdraw its prior protest.

The Court held oral arguments on the parties’ motion on February 10, 2015. For the

reasons set forth below, the Court concludes that the government is entitled to judgment on the

administrative record because the agency’s decision to rate EOR as red/unacceptable on its

technical proposal was neither arbitrary, nor capricious, nor contrary to law. In light of that

ruling, EOR was ineligible for an award under the terms of the solicitation, see AR 10:176, and it

is unnecessary for the Court to address EOR’s other challenges to the agency’s award decision.

DISCUSSION

I. Jurisdiction

The Court of Federal Claims has “jurisdiction to render judgment on an action by an

interested party objecting to . . . a proposed award or the award of a contract or any alleged

violation of statute or regulation in connection with a procurement or a proposed procurement.”

28 U.S.C. § 1491(b)(1) (2012). A party is an “interested party” with standing to bring suit under

28 U.S.C. § 1491(b)(1) if the party “is an actual or prospective bidder whose direct economic

interest would be affected by the award of the contract.” Orion Tech., Inc. v. United States, 704

7

F.3d 1344, 1348 (Fed. Cir. 2013). An offeror has a direct economic interest if it suffered a

competitive injury or prejudice. Myers Investigative & Sec. Servs., Inc. v. United States, 275

F.3d 1366, 1370 (Fed. Cir. 2002) (holding that “prejudice (or injury) is a necessary element of

standing”).

In a post-award bid protest, the protestor has suffered prejudice if it would have had a

“substantial chance” of winning the award “but for the alleged error in the procurement process.”

Info. Tech. & Applications Corp. v. United States, 316 F.3d 1312, 1319 (Fed. Cir. 2003). See

also Weeks Marine, Inc. v. United States, 575 F.3d 1352, 1359 (Fed. Cir. 2009); Rex Serv. Corp.

v. United States, 448 F.3d 1305, 1308 (Fed. Cir. 2006). “In other words, the protestor’s chance

of securing the award must not have been insubstantial.” Info. Tech., 316 F.3d at 1319.

Neither the government nor Premier disputes that EOR is an “interested party” within the

meaning of the statute. EOR was an actual offeror for the contract in question. Although EOR

was ranked seventh out of nine offerors, it proposed the lowest price and received slightly higher

technical ratings than the other unsuccessful offerors. If all of EOR’s allegations were found

meritorious, including its challenge to the assessment of a deficiency in its technical proposal,

then “all of the agency’s ratings would need to be redone, and a new best value determination

made.” Preferred Sys. Solutions v. United States, 110 Fed. Cl. 48, 57 (2013). Because EOR

would have had a not insubstantial chance of securing the award upon a ruling that the agency’s

technical evaluation of its proposal was erroneous or that award to Premier was invalid, EOR has

established its standing as an interested party.

II. Standard for Granting Judgment on the Administrative Record

Pursuant to RCFC 52.1, the Court reviews an agency’s procurement decision based on

the administrative record. Bannum, Inc., 404 F.3d at 1354. The Court makes “factual findings

under RCFC [52.1] from the record evidence as if it were conducting a trial on the record.” Id. at

1357. Thus, “resolution of a motion respecting the administrative record is akin to an expedited

trial on the paper record, and the Court must make fact findings where necessary.” Baird v.

United States, 77 Fed. Cl. 114, 116 (2007). The court’s inquiry is “whether, given all the

disputed and undisputed facts, a party has met its burden of proof based on the evidence in the

record.” A&D Fire Prot., Inc. v. United States, 72 Fed. Cl. 126, 131 (2006). Unlike a summary

judgment proceeding, genuine issues of material fact will not foreclose judgment on the

administrative record. Bannum, Inc., 404 F.3d at 1356.

III. Standard of Review in Bid Protest Cases

The court reviews challenges to a contract award under the same standards used to

evaluate agency action under the Administrative Procedure Act (“APA”), 5 U.S.C. § 706 (2012).

See 28 U.S.C. § 1491(b)(4) (stating that “[i]n any action under this subsection, the courts shall

review the agency’s decision pursuant to the standards set forth in section 706 of title 5”). To

successfully challenge an agency’s procurement decision, a plaintiff must show that the agency’s

decision was “arbitrary, capricious, an abuse of discretion, or otherwise not in accordance with

law.” 5 U.S.C. § 706(2)(A); Bannum, Inc., 404 F.3d at 1351. “The arbitrary and capricious

standard applicable here is highly deferential. This standard requires a reviewing court to sustain

8

an agency action evincing rational reasoning and consideration of relevant factors.” Advanced

Data Concepts, Inc. v. United States, 216 F.3d 1054, 1058 (Fed. Cir. 2000) (citing Bowman

Transp., Inc. v. Arkansas-Best Freight Sys., Inc., 419 U.S. 281, 285 (1974)).

In a bid protest, the disappointed offeror “bears a heavy burden” in attempting to show

that a procuring agency’s decision lacked a rational basis. Impresa Construzioni Geom.

Domenico Garufi v. United States, 238 F.3d 1324, 1338 (Fed. Cir. 2001). Indeed, such a

challenge can succeed only where the agency “entirely failed to consider an important aspect of

the problem, offered an explanation for its decision that runs counter to the evidence before the

agency, or [the decision] is so implausible that it could not be ascribed to a difference in view or

the product of agency expertise.” Ala. Aircraft Indus., Inc.–Birmingham v. United States, 586

F.3d 1372, 1375 (Fed. Cir. 2009) (alteration in original) (quoting Motor Vehicle Mfrs. Ass’n v.

State Farm Mut. Auto Ins. Co. (“State Farm”), 463 U.S. 29, 43 (1983)).

The Court is particularly deferential to an agency’s technical evaluation. E.W. Bliss Co.

v. United States, 77 F.3d 445, 449 (Fed. Cir. 1996) (stating that “such matters as technical

ratings” involve “the minutiae of the procurement process . . . that a court will not second

guess”). “This is because the evaluation of proposals for their technical excellence or quality is a

process that often requires the special expertise of procurement officials, and thus reviewing

courts give the greatest deference possible to these determinations.” One Largo Metro, LLC v.

United States, 109 Fed. Cl. 39, 74 (2013) (alteration and internal quotations marks omitted)

(quoting Beta Analytics Int’l, Inc. v. United States, 67 Fed. Cl. 384, 395 (2009)).

Given this highly deferential standard of review, the court’s function is limited to

“determin[ing] whether ‘the contracting agency provided a coherent and reasonable explanation

of its exercise of discretion.’” Impresa, 238 F.3d at 1332-33 (quoting Saratoga Dev. Corp. v.

United States, 21 F.3d 445, 456 (D.C. Cir. 1994)). The agency need only articulate a “rational

connection between the facts found and the choice made,” and the court will “uphold a decision

of less than ideal clarity if the agency’s path may reasonably be discerned.” State Farm, 463

U.S. at 43.

IV. The Government Is Entitled to Judgment on the Administrative Record

As described above, the agency found EOR’s technical proposal deficient3 because the

curricula that EOR submitted for four of five sample courses were incomplete. Specifically, the

agency concluded, EOR did not include samples of the quizzes/progress checks or tests that EOR

stated would be administered as part of those courses. EOR claims that this finding was

incorrect and contrary to the record. The Court disagrees.

As described above, the solicitation required offerors to provide “five (5) samples of

current complete curriculum to include lesson plans, quizzes/progress checks and tests for

courses.” AR 10:168. After the issuance of the solicitation, the agency clarified that

3

A “deficiency” is a “material failure of a proposal to meet a Government requirement or a

combination of significant weaknesses in a proposal that increases the risk of unsuccessful

contract performance to an unacceptable level.” FAR 15.001.

9

“‘curriculum’ refers to the entire course” conducted by the offeror, and that “a comprehensive

course syllabus that covers daily lesson plans, . . . quizzes, test[s], and student progress” would

not satisfy the solicitation’s requirement. AR 11:317. The parties agree that the solicitation

required offerors to include any quizzes or tests actually used in its curricula. Furthermore, the

solicitation stated that the “curriculum samples [would] be considered as an indicator of

technical capability.” AR 10:168. According to the agency, EOR failed to meet a material

requirement of the solicitation because it did “not provid[e] samples of quizzes/progress checks

or tests for . . . [its] Arabic Refresher, Bambara Advanced, French Basic, and French

Intermediate” courses. AR 54:8259. This conclusion was eminently reasonable and clearly

supported by the administrative record.

EOR stated in each of its curricula that tests and quizzes would be administered as part of

each class. For example, for its Arabic Refresher course for advanced students, EOR stated that

the course included grammar quizzes, unit tests, weekly exams, and writing assignments. See

AR 16:528, 530 (noting that as part of the course objectives, students were required “to score at

least 70% on all assessment modalities: unit tests, weekly exams and homework”; “score [] at

least 70% in the 10 grammar quizzes”; and “score at least 70% on your writing assignment”).

EOR contends that “‘Quiz[zes]’ meaning Examination[s]” are included in the curriculum as well

as progress reports, a half term examination, a mid-term examination, and a final examination.

Pl.’s MJAR 8. The pages identified by EOR as containing quizzes or tests, however, are

virtually blank, containing only a single line at the top right hand corner of the page that includes

the words “Test/Exam” in Arabic and specifies the number of minutes allowed. AR 16:553, 573,

583, 596, 618, 640, 663, 678, 694, 706, 734, 746, 759, 770. See also LeBlanc Decl. ¶¶ 4-31,

Def.’s Unopposed Mot. Supplement AR Ex. B, Dec. 5, 2014, ECF No. 23. These blank pages

are plainly not sufficient to meet the specifications of the solicitation that required EOR to

actually include the contents of any tests or quizzes for each course in which it intended to

administer such quizzes and tests.4

Similarly, in a section of its Bambara Advanced curriculum titled “Testing Schedule

Formula,” EOR stated that “[a] quiz will be given every day to test the mastery of previous

lessons” and “an exam will be given in the middle and at the end of the semester.” AR 16:783.

It further stated that the midterm and final exam would be administered in class by the professor.

Id.5

4

On January 27, 2015, the defendant notified the Court that the blank pages in EOR’s Arabic

curriculum labeled “Test/Exam” actually contained hidden text that for whatever reason is not

apparently visible on the electronic or hard copies of EOR’s proposal. Def.’s Notice 1-2, ECF

No. 38. This technical problem may explain but does not excuse EOR’s non-compliance with

the solicitation’s requirements. The agency cannot reasonably have been expected to guess that

an apparently blank page in EOR’s proposal contained hidden text in the electronic copy which

was visible only when the page was highlighted.

5

The syllabus for the Bambara Advanced course also recommended that instructors distribute

periodic progress reports each week. The periodic progress report is a form that is to be filled

out by the course instructor for each individual student in which the instructor assesses the

student’s skills in areas such as simple short conversations, reporting facts about current events,

10

The end of each lesson plan for the Bambara course includes “Exercises,” “TDA,” and

“Self-Evaluation,” all of which ask students to recall and use the skills and knowledge gained

from the day’s lesson. See AR 16:815-16, 824, 828, 835-37, 841-43, 850-52, 862-63, 867-70,

876-77, 885, 889-90, 894, 898, 902, 908-09, 915, 923. Students are then asked to evaluate

themselves on specific skills like, “I can speak about daily activities: YES____ NOT

YET____.”

EOR contends that the Exercises at the end of each lesson constitute the quizzes that it

planned to “give[] every day to test the mastery of previous lessons” in accordance with the

testing schedule and formula. Pl.’s MJAR 1. Moreover, EOR contends, the exercises and

progress checks taken together are within the meaning of “quiz/progress check” as used in the

solicitation since they “serve the function of testing and evaluation of the student on a daily

basis.” Pl.’s Resp. & Reply 1. These contentions are unavailing.

First, as noted, EOR’s syllabus for the Bambara Advanced course states that instructors

will administer a midterm and final exam to students. EOR does not provide any citation to

material in its proposal that the agency should reasonably have construed as a midterm or final

exam and the Court has not found any. Further, at the oral argument in this case, counsel for

EOR acknowledged that the final and midterm exams for this course (and for the other courses)

were “just not there.” See Oral Arg., 11:39:38-11:39:41.

It was also not unreasonable for the agency to conclude that EOR’s proposal failed to

provide the copies of the daily quizzes it discussed in its syllabus. The daily “exercises” which

EOR now contends the agency should have recognized as “quizzes” were not identified as such

in EOR’s materials. And, as the record shows, when EOR wants to identify a series of questions

as a “quiz,” it knows how to do so—as it did in the Arabic course and in the syllabus for the

Bambara course. See, e.g., AR 16:530. Moreover, the agency’s conclusion that the exercises

were not quizzes or tests comports with the plain and ordinary meaning of the word “exercise” as

used in the educational context, which is “a particular task or set of tasks devised as exercise,

practice in a technique, etc.” or a mental activity “esp. as practice to develop a faculty.” Oxford

English Reference Dictionary 490 (rev. 2d ed. 2002). By contrast, the use of the word “quiz” or

“examination” in this context connotes not a vehicle for a student to practice his skills, but rather

a test or assessment which will be scored to measure a student’s knowledge of the course

material.

EOR’s French Intermediate and French Beginner’s courses proposed the same testing

requirements as the Bambara course. Thus, for each course, EOR stated that “a quiz will be

given every day to test the mastery of previous lessons. An exam will be given in the middle and

understanding speech about basic needs, or reading simple authentic material. AR 16:796-97. In

addition, the instructor is to rate students on whether they are below average, average, above

average or superior on their pronunciation, fluency, grammar control, and vocabulary retention.

Part three of the progress report includes an optional place for the instructor to include an

achievement test score, expressed as a percentage. Students were also encouraged to evaluate

their own progress at the end of each week. AR 16:783.

11

at the end of the semester.” AR 17:963, 1045. Like the Bambara course, students were also to

receive a weekly periodic assessment report assessing a student’s proficiency in the language.

EOR contends that it met the requirements of the solicitation because its French courses include

“Periodic Assessment Reports” as well as “‘Exercices in French’ meaning quizzes,” and tests.

Pl.’s MJAR. 7-8.

As with the Advanced Bambara course, however, the tests EOR stated it would

administer at the middle and at the end of the semester are absent from the curricula for both

Intermediate and Beginner French. The French curricula contain references to the administration

of tests, and include placeholders for such tests, but copies of the tests are not included in the

course samples. See AR 17:1098, 1030, 1103. Again similar to the Advanced Bambara course,

none of the pages of the administrative record that EOR has cited with respect to its two French

courses include materials that are identified as quizzes. Further, the word “exercices” in French

means “exercises,” not “quizzes.” See Kendall Decl. ¶¶ 4-7. And, as explained above, the

agency had ample basis to find that the “exercises” were not the “quizzes” that EOR referred to

in its course design.

As perhaps its final Hail Mary pass, EOR contends that “[t]o the extent that one or more

of the curricula [are] lacking or ‘weak’ . . . there is no question that the source material for

quizzes and daily exercises is present in the curricula provided.” Pl.’s Resp. & Reply, Dec. 16,

2014, ECF No. 31; see also Oral Arg., 11:37:06-11:37:35 (stating that EOR intended to create

examinations by “using the exercises that are included and then compiling them as types of[,] as

a type of midterm as a type of final”). But the solicitation specifically required offerors to

include lesson plans, quizzes/progress checks, and tests that were going to be administered in the

courses, not material that could be used to create these instruments. Further, to the extent that

EOR intended to redeploy the instructional materials it submitted as quizzes/progress checks and

tests, it failed to advise the agency of that intention. In short, this argument is unsupported by

the record and is, at best, a post hoc rationalization of EOR’s failure to supply the quizzes and

tests along with its proposal.

Indeed, the deficiencies of EOR’s submission are highlighted by comparing EOR’s

curricula to the submission of the contract awardee, Premier.6 For all of its courses, Premier

included a short section near the beginning of each curriculum stating that it would use both

formal and informal assessments. AR 23:1501; AR 24:2199-200; AR 25:3106-07; AR 26:5465;

AR 27:6512. It then supplied sample copies of all of the assessment tools its curricula stated that

it would use in the courses. See AR Tabs 23-27.

Thus, for its Intermediate and Expedited Pashto courses, Premier provided copies of the

formal assessments it intended to use, which consisted of tests and quizzes. For example, the

6

The Court requested supplemental briefs from the parties asking them to identify which parts of

the administrative record reflect “quizzes/progress checks and tests” submitted by the contract

awardee, Premier. Order, January 16, 2015, ECF No. 36. See Tech. Sys. v. United States, 98

Fed. Cl. 228, 253 (2011) (noting that, in some cases, the court may examine whether features of

a proposal that are highly rated are similar to another proposal that is not similarly credited).

12

Intermediate Pashto course included weekly reading and listening tests, as well as “pre-” and

“post-tests,” given at the beginning and [at] the end of the course respectively. AR 24:2199,

2322-27, 2475-81, 2546-50, 2687-92, 2246-71 (pre-test), 3079-97 (post-test). The expedited

course, in addition to listening and reading tests, also incorporates daily quizzes, vocabulary

quizzes, speaking tests, and mid-term tests, all of which were included in Premier’s proposal.

AR 25:3106-07, 3178, 3205, 3249 (examples of daily quizzes), 3414-15, 3780-81, 3986-87

(examples of speaking tests), 3417-23, 3786-94, 3988-98 (examples of listening and reading

tests); 4302-15, 4317-4340 (mid-term tests).

Premier did not propose to use its own formal assessments for three of its curricula. For

example, for its Persian-Farsi course, Premier stated that the formal assessment for the course

was the DLPT.7 AR 27:6512. Premier explained that “[t]his course is designed as a refresher

course. As such, it is highly encouraged that the students [take the] DLPT upon course

completion, or as directed by their CLPM or their unit.” Premier provided similar responses for

its Arabic Dialect and Persian-Dari refresher courses. See AR 23:1501; AR 26:5465.

Premier stated that it would use informal assessments for these courses. These informal

assessments would consist of self-check questions, optional homework assignments, and

opportunities for students to present questions to and request clarification from the instructor at

the end of each day. AR 23:1501; AR 26:5465; AR 27:6512. Premier then went on to include

samples of these informal assessments in its curricula. See, e.g., AR 23: 1510, 1514-15, 1518-

19, 1540-41, 1543; AR 26:5487-510, 5549, 5571-72, 5585-86; AR 27:6522-31, 6542-48, 6561-

68, 6576-83, 6829-33.

Plaintiff argues that—because Premier used informal rather than formal assessments for

these courses—its submission was as deficient as EOR’s. See Pl.’s Reply to Def.’s Resp. to Ct.

Order 1-2, Jan. 30, 2015, ECF No. 39. This contention is unpersuasive. The solicitation did not

require the use of formal assessments; it simply required that if such assessments were to be

used, then sample copies would be provided as part of the offeror’s proposal. Premier outlined

the assessment strategy used in each of its courses, provided the materials it had created to

implement those strategies, and clearly identified its assessment tools as such in its submission.8

Finally, because the agency’s assignment of a deficiency had a rational basis, the agency

acted reasonably in rating EOR as red/unacceptable on its technical proposal. Thus, pursuant to

the terms of the solicitation, a proposal containing one or more deficiencies must be assigned a

technical rating of red/unacceptable, which makes it ineligible for award. AR 10:176. For that

reason, the Court need not address EOR’s other challenges to the ratings assigned to its proposal

by the Air Force. See Glenn Defense Marine (Asia), PTE Ltd. v. United States, 720 F.3d 901,

912 (Fed. Cir. 2013) (noting that plaintiff failed to show prejudicial error where it could not

7

DLPT stands for Defense Language Proficiency Test. AR 10:257.

8

Premier did not include copies of DLPTs in its submission. It was not unreasonable for the

agency not to assess any deficiency on that basis because the DLPT is created by the Defense

Language Institute, used by the United States Department of Defense, and is administered by the

government, not Premier. See AR 10:244.

13

show that even if the agency had erred in its past performance ratings, it would have had a

substantial chance of winning the award).

CONCLUSION

As described above, EOR failed to meet a requirement of the solicitation which the

agency considered material, making its proposal ineligible for contract award. Consequently,

EOR has failed to establish the merit of its claims by showing any error, prejudicial or otherwise,

in the procurement process. Accordingly, the government’s motion for judgment on the

administrative record is GRANTED. The plaintiff’s motion for judgment on the administrative

record is DENIED. Each party shall bear its own costs.

IT IS SO ORDERED.

s/ Elaine D. Kaplan

ELAINE D. KAPLAN

Judge

14