IKRIS - Revision history

DavidWhitten: /* 3.3 Lessons Learned (pg 15) */

2021-05-08T03:58:47Z

‎3.3 Lessons Learned (pg 15)

DavidWhitten: /* 3.2 Recommendations (pg 14) */

2021-05-08T03:58:02Z

‎3.2 Recommendations (pg 14)

DavidWhitten: /* 3 Conclusions, Recommendations and Lessons Learned (pg 13) */

2021-05-08T03:57:26Z

‎3 Conclusions, Recommendations and Lessons Learned (pg 13)

DavidWhitten: /* 3 Conclusions, Recommendations and Lessons Learned (pg 13) */

2021-05-08T03:54:46Z

‎3 Conclusions, Recommendations and Lessons Learned (pg 13)

DavidWhitten: /* 3 Conclusions, Recommendations and Lessons Learned (pg 13) */

2021-05-08T03:49:46Z

‎3 Conclusions, Recommendations and Lessons Learned (pg 13)

DavidWhitten: /* 2.2 Direct Technical Support (pg 9) */

2021-05-08T03:43:30Z

‎2.2 Direct Technical Support (pg 9)

DavidWhitten: /* 2.1 Administration and Logistics Support (pg 8) */

2021-05-08T03:40:02Z

‎2.1 Administration and Logistics Support (pg 8)

DavidWhitten: /* 2.1 Administration and Logistics Support (pg 8) */

2021-05-08T03:39:31Z

‎2.1 Administration and Logistics Support (pg 8)

DavidWhitten: /* 2 Summary of MITRE Support Activities (pg 8) */

2021-05-08T03:37:49Z

‎2 Summary of MITRE Support Activities (pg 8)

DavidWhitten: /* 2 Summary of MITRE Support Activities (pg 8) = */

2021-05-08T03:35:59Z

‎2 Summary of MITRE Support Activities (pg 8) =

@@ Line 241: / Line 241: @@
 ==== 3.3	Lessons Learned	(pg 15) ====
   Reflecting on our IKRIS experience, we were able to assess a number of organizational and process methods and decisions.
-<BLOCKQUOTE>
   Some of the lessons learned and/or best practices that may be of interest to future workshops include:
+:

@@ Line 232: / Line 232: @@
 </BLOCKQUOTE>
 ==== 3.2	Recommendations (pg 14) ====
   We offer two recommendations to DTO, with a view towards making progress on the long-range goal of creating more powerful and capable KR&R-based analyst-support tools.
+:
@@ Line 237: / Line 238: @@
+:
 :<B>2.</B>	Convene a strategic R&D planning workshop tasked to develop a research roadmap for further investment in cross-cutting KR&R technologies (including IKRIS-enabled interoperating KR&R systems) that have demonstrable IC applications.  Such a workshop should bring together representatives from Science and Technology (S&T), Research and Development, Acquisition, and Operations organizations across the IC, KR&R researchers from academia and industry, and should also include analyst representatives to advise on end-user application concepts.  Starting with tutorials on KR&R principles, techniques and existing technologies, this workshop could identify technical gaps and application concepts, and define a sustained investment plan leading to operationally effective KR&R-based analyst-support tools.
 ==== 3.3	Lessons Learned	(pg 15) ====

@@ Line 221: / Line 221: @@
   Based on our many conversations with IC staff during our outreach efforts, we offer these conclusions:
+:
-:1.	The IKRIS project has made a valuable contribution to the long-range goal of creating more powerful and capable analyst-support tools that build upon advanced knowledge representation and reasoning (KR&R) technologies.  The significance of the IKRIS technical results is recognized and appreciated within the KR&R branch of the Computer Science/Artificial Intelligence community.
+:<b>1.</B>	The IKRIS project has made a valuable contribution to the long-range goal of creating more powerful and capable analyst-support tools that build upon advanced knowledge representation and reasoning (KR&R) technologies.  The significance of the IKRIS technical results is recognized and appreciated within the KR&R branch of the Computer Science/Artificial Intelligence community.
+:
-:2.	The terms “knowledge representation” (KR) and “knowledge base” (KB) have very specific meanings within the IKRIS research community.  In IKRIS, KR is a technical discipline in which various kinds of human knowledge are expressed in mathematically precise logical forms which permit the automated generation of new knowledge structures by the application of machine inference techniques; KBs serve as repositories of these precise knowledge structures.  In contrast, IC technical staff typically use the term “knowledge base” to mean a conventional (relational) database that serves as a repository of organizational knowledge about intelligence targets; in this parlance, KR is the process of populating an intelligence database.  Although exceptions were found, the IKRIS meanings of KR and KB are correctly understood and appreciated largely in niche communities found within IC agency science and technology research directorates, rather than acquisition or operational directorates.
+:<B>2.</B>	The terms “knowledge representation” (KR) and “knowledge base” (KB) have very specific meanings within the IKRIS research community.  In IKRIS, KR is a technical discipline in which various kinds of human knowledge are expressed in mathematically precise logical forms which permit the automated generation of new knowledge structures by the application of machine inference techniques; KBs serve as repositories of these precise knowledge structures.  In contrast, IC technical staff typically use the term “knowledge base” to mean a conventional (relational) database that serves as a repository of organizational knowledge about intelligence targets; in this parlance, KR is the process of populating an intelligence database.  Although exceptions were found, the IKRIS meanings of KR and KB are correctly understood and appreciated largely in niche communities found within IC agency science and technology research directorates, rather than acquisition or operational directorates.
+:
-:3.	At present, there appears to be only one significant operational deployment of an analyst-support system which employs KR&R technologies like those considered by IKRIS.  The manager of this particular program has been an active participant in IKRIS, and served as a Government Champion.  KR&R technologies are otherwise employed principally in demonstration prototypes developed under advanced R&D initiatives (including DTO programs such as NIMD and AQUAINT).  Staff members within several major IC organizations are actively tracking developments in the KR&R arena, with the expectation that as the underlying technologies mature, their organizations will have a clear interest in making use of envisaged applications.
+:<B>3.</B>	At present, there appears to be only one significant operational deployment of an analyst-support system which employs KR&R technologies like those considered by IKRIS.  The manager of this particular program has been an active participant in IKRIS, and served as a Government Champion.  KR&R technologies are otherwise employed principally in demonstration prototypes developed under advanced R&D initiatives (including DTO programs such as NIMD and AQUAINT).  Staff members within several major IC organizations are actively tracking developments in the KR&R arena, with the expectation that as the underlying technologies mature, their organizations will have a clear interest in making use of envisaged applications.
+:
-:4.	IKRIS has focused on enabling interoperability among heterogeneous KR&R systems.  This is a significant problem, and the value in solving it is illustrated by the Capstone Demonstration.  The IKRIS effort should be understood as having anticipated this problem and developed a solution approach for it well before it becomes an obstacle to the development and deployment of analyst-support tools in the operational IC.
+:<B>4.</B>	IKRIS has focused on enabling interoperability among heterogeneous KR&R systems.  This is a significant problem, and the value in solving it is illustrated by the Capstone Demonstration.  The IKRIS effort should be understood as having anticipated this problem and developed a solution approach for it well before it becomes an obstacle to the development and deployment of analyst-support tools in the operational IC.
+:
-:5.	Although KR&R is a cross-cutting enabling technology for intelligence analysis support, there is no clear R&D “champion” for it at present in the Intelligence Community.  To date, advances in KR&R methods and IC applications have been made in fits and starts under the auspices of research initiatives with broader charters (e.g., the NIMD and AQUAINT programs).  As a result, there has been a lack of sustained, IC-focused advancement in KR&R fundamentals, jeopardizing the steady maturation of deployable applications.  While the IKRIS Workshop has made an important technical contribution, in the absence of a KR&R champion for IC-focused R&D, there is legitimate concern that the full impact of the IKRIS work might not be realized.
+:<B>5.</B>	Although KR&R is a cross-cutting enabling technology for intelligence analysis support, there is no clear R&D “champion” for it at present in the Intelligence Community.  To date, advances in KR&R methods and IC applications have been made in fits and starts under the auspices of research initiatives with broader charters (e.g., the NIMD and AQUAINT programs).  As a result, there has been a lack of sustained, IC-focused advancement in KR&R fundamentals, jeopardizing the steady maturation of deployable applications.  While the IKRIS Workshop has made an important technical contribution, in the absence of a KR&R champion for IC-focused R&D, there is legitimate concern that the full impact of the IKRIS work might not be realized.
 </BLOCKQUOTE>
 ==== 3.2	Recommendations (pg 14) ====
   We offer two recommendations to DTO, with a view towards making progress on the long-range goal of creating more powerful and capable KR&R-based analyst-support tools.
+:
-:1.	Continue IC outreach efforts to raise awareness of IKRIS technical results.  Most of the outreach efforts conducted by MITRE were carried out while IKRIS specifications were still undergoing active development, so outreach had the main effect of providing advance notice of accomplishments to come.  Now that the work is complete, DTO should make the technical specifications publicly available and accessible on the Internet, on Intelink, and on specific Intelligence Agency intranets.  IKRIS technical briefings and User’s Group sessions should be scheduled during future Principal Investigators meetings for DTO programs in Information Exploitation.
+:<B>1.</B>	Continue IC outreach efforts to raise awareness of IKRIS technical results.  Most of the outreach efforts conducted by MITRE were carried out while IKRIS specifications were still undergoing active development, so outreach had the main effect of providing advance notice of accomplishments to come.  Now that the work is complete, DTO should make the technical specifications publicly available and accessible on the Internet, on Intelink, and on specific Intelligence Agency intranets.  IKRIS technical briefings and User’s Group sessions should be scheduled during future Principal Investigators meetings for DTO programs in Information Exploitation.
+:
-:2.	Convene a strategic R&D planning workshop tasked to develop a research roadmap for further investment in cross-cutting KR&R technologies (including IKRIS-enabled interoperating KR&R systems) that have demonstrable IC applications.  Such a workshop should bring together representatives from Science and Technology (S&T), Research and Development, Acquisition, and Operations organizations across the IC, KR&R researchers from academia and industry, and should also include analyst representatives to advise on end-user application concepts.  Starting with tutorials on KR&R principles, techniques and existing technologies, this workshop could identify technical gaps and application concepts, and define a sustained investment plan leading to operationally effective KR&R-based analyst-support tools.
+:<B>2.</B>	Convene a strategic R&D planning workshop tasked to develop a research roadmap for further investment in cross-cutting KR&R technologies (including IKRIS-enabled interoperating KR&R systems) that have demonstrable IC applications.  Such a workshop should bring together representatives from Science and Technology (S&T), Research and Development, Acquisition, and Operations organizations across the IC, KR&R researchers from academia and industry, and should also include analyst representatives to advise on end-user application concepts.  Starting with tutorials on KR&R principles, techniques and existing technologies, this workshop could identify technical gaps and application concepts, and define a sustained investment plan leading to operationally effective KR&R-based analyst-support tools.
 ==== 3.3	Lessons Learned	(pg 15) ====

@@ Line 215: / Line 215: @@
 === 3	Conclusions, Recommendations and Lessons Learned (pg 13) ===
 ==== 3.1	Conclusions (pg 13) ====
 ==== 3.2	Recommendations (pg 14) ====
 ==== 3.3	Lessons Learned	(pg 15) ====

← Older revision		Revision as of 03:54, 8 May 2021
Line 220:		Line 220:
	<BLOCKQUOTE>		<BLOCKQUOTE>
	Based on our many conversations with IC staff during our outreach efforts, we offer these conclusions:		Based on our many conversations with IC staff during our outreach efforts, we offer these conclusions:
		+	:
	:1. The IKRIS project has made a valuable contribution to the long-range goal of creating more powerful and capable analyst-support tools that build upon advanced knowledge representation and reasoning (KR&R) technologies. The significance of the IKRIS technical results is recognized and appreciated within the KR&R branch of the Computer Science/Artificial Intelligence community.		:1. The IKRIS project has made a valuable contribution to the long-range goal of creating more powerful and capable analyst-support tools that build upon advanced knowledge representation and reasoning (KR&R) technologies. The significance of the IKRIS technical results is recognized and appreciated within the KR&R branch of the Computer Science/Artificial Intelligence community.
−		+	:
	:2. The terms “knowledge representation” (KR) and “knowledge base” (KB) have very specific meanings within the IKRIS research community. In IKRIS, KR is a technical discipline in which various kinds of human knowledge are expressed in mathematically precise logical forms which permit the automated generation of new knowledge structures by the application of machine inference techniques; KBs serve as repositories of these precise knowledge structures. In contrast, IC technical staff typically use the term “knowledge base” to mean a conventional (relational) database that serves as a repository of organizational knowledge about intelligence targets; in this parlance, KR is the process of populating an intelligence database. Although exceptions were found, the IKRIS meanings of KR and KB are correctly understood and appreciated largely in niche communities found within IC agency science and technology research directorates, rather than acquisition or operational directorates.		:2. The terms “knowledge representation” (KR) and “knowledge base” (KB) have very specific meanings within the IKRIS research community. In IKRIS, KR is a technical discipline in which various kinds of human knowledge are expressed in mathematically precise logical forms which permit the automated generation of new knowledge structures by the application of machine inference techniques; KBs serve as repositories of these precise knowledge structures. In contrast, IC technical staff typically use the term “knowledge base” to mean a conventional (relational) database that serves as a repository of organizational knowledge about intelligence targets; in this parlance, KR is the process of populating an intelligence database. Although exceptions were found, the IKRIS meanings of KR and KB are correctly understood and appreciated largely in niche communities found within IC agency science and technology research directorates, rather than acquisition or operational directorates.
−		+	:
	:3. At present, there appears to be only one significant operational deployment of an analyst-support system which employs KR&R technologies like those considered by IKRIS. The manager of this particular program has been an active participant in IKRIS, and served as a Government Champion. KR&R technologies are otherwise employed principally in demonstration prototypes developed under advanced R&D initiatives (including DTO programs such as NIMD and AQUAINT). Staff members within several major IC organizations are actively tracking developments in the KR&R arena, with the expectation that as the underlying technologies mature, their organizations will have a clear interest in making use of envisaged applications.		:3. At present, there appears to be only one significant operational deployment of an analyst-support system which employs KR&R technologies like those considered by IKRIS. The manager of this particular program has been an active participant in IKRIS, and served as a Government Champion. KR&R technologies are otherwise employed principally in demonstration prototypes developed under advanced R&D initiatives (including DTO programs such as NIMD and AQUAINT). Staff members within several major IC organizations are actively tracking developments in the KR&R arena, with the expectation that as the underlying technologies mature, their organizations will have a clear interest in making use of envisaged applications.
−		+	:
	:4. IKRIS has focused on enabling interoperability among heterogeneous KR&R systems. This is a significant problem, and the value in solving it is illustrated by the Capstone Demonstration. The IKRIS effort should be understood as having anticipated this problem and developed a solution approach for it well before it becomes an obstacle to the development and deployment of analyst-support tools in the operational IC.		:4. IKRIS has focused on enabling interoperability among heterogeneous KR&R systems. This is a significant problem, and the value in solving it is illustrated by the Capstone Demonstration. The IKRIS effort should be understood as having anticipated this problem and developed a solution approach for it well before it becomes an obstacle to the development and deployment of analyst-support tools in the operational IC.
−		+	:
	:5. Although KR&R is a cross-cutting enabling technology for intelligence analysis support, there is no clear R&D “champion” for it at present in the Intelligence Community. To date, advances in KR&R methods and IC applications have been made in fits and starts under the auspices of research initiatives with broader charters (e.g., the NIMD and AQUAINT programs). As a result, there has been a lack of sustained, IC-focused advancement in KR&R fundamentals, jeopardizing the steady maturation of deployable applications. While the IKRIS Workshop has made an important technical contribution, in the absence of a KR&R champion for IC-focused R&D, there is legitimate concern that the full impact of the IKRIS work might not be realized.		:5. Although KR&R is a cross-cutting enabling technology for intelligence analysis support, there is no clear R&D “champion” for it at present in the Intelligence Community. To date, advances in KR&R methods and IC applications have been made in fits and starts under the auspices of research initiatives with broader charters (e.g., the NIMD and AQUAINT programs). As a result, there has been a lack of sustained, IC-focused advancement in KR&R fundamentals, jeopardizing the steady maturation of deployable applications. While the IKRIS Workshop has made an important technical contribution, in the absence of a KR&R champion for IC-focused R&D, there is legitimate concern that the full impact of the IKRIS work might not be realized.
	</BLOCKQUOTE>		</BLOCKQUOTE>
	==== 3.2 Recommendations (pg 14) ====		==== 3.2 Recommendations (pg 14) ====
	We offer two recommendations to DTO, with a view towards making progress on the long-range goal of creating more powerful and capable KR&R-based analyst-support tools.		We offer two recommendations to DTO, with a view towards making progress on the long-range goal of creating more powerful and capable KR&R-based analyst-support tools.
		+	:
	:1. Continue IC outreach efforts to raise awareness of IKRIS technical results. Most of the outreach efforts conducted by MITRE were carried out while IKRIS specifications were still undergoing active development, so outreach had the main effect of providing advance notice of accomplishments to come. Now that the work is complete, DTO should make the technical specifications publicly available and accessible on the Internet, on Intelink, and on specific Intelligence Agency intranets. IKRIS technical briefings and User’s Group sessions should be scheduled during future Principal Investigators meetings for DTO programs in Information Exploitation.		:1. Continue IC outreach efforts to raise awareness of IKRIS technical results. Most of the outreach efforts conducted by MITRE were carried out while IKRIS specifications were still undergoing active development, so outreach had the main effect of providing advance notice of accomplishments to come. Now that the work is complete, DTO should make the technical specifications publicly available and accessible on the Internet, on Intelink, and on specific Intelligence Agency intranets. IKRIS technical briefings and User’s Group sessions should be scheduled during future Principal Investigators meetings for DTO programs in Information Exploitation.
		+	:
	:2. Convene a strategic R&D planning workshop tasked to develop a research roadmap for further investment in cross-cutting KR&R technologies (including IKRIS-enabled interoperating KR&R systems) that have demonstrable IC applications. Such a workshop should bring together representatives from Science and Technology (S&T), Research and Development, Acquisition, and Operations organizations across the IC, KR&R researchers from academia and industry, and should also include analyst representatives to advise on end-user application concepts. Starting with tutorials on KR&R principles, techniques and existing technologies, this workshop could identify technical gaps and application concepts, and define a sustained investment plan leading to operationally effective KR&R-based analyst-support tools.		:2. Convene a strategic R&D planning workshop tasked to develop a research roadmap for further investment in cross-cutting KR&R technologies (including IKRIS-enabled interoperating KR&R systems) that have demonstrable IC applications. Such a workshop should bring together representatives from Science and Technology (S&T), Research and Development, Acquisition, and Operations organizations across the IC, KR&R researchers from academia and industry, and should also include analyst representatives to advise on end-user application concepts. Starting with tutorials on KR&R principles, techniques and existing technologies, this workshop could identify technical gaps and application concepts, and define a sustained investment plan leading to operationally effective KR&R-based analyst-support tools.

	==== 3.3 Lessons Learned (pg 15) ====		==== 3.3 Lessons Learned (pg 15) ====
	Reflecting on our IKRIS experience, we were able to assess a number of organizational and process methods and decisions.		Reflecting on our IKRIS experience, we were able to assess a number of organizational and process methods and decisions.
−		+	<BLOCKQUOTE>
	Some of the lessons learned and/or best practices that may be of interest to future workshops include:		Some of the lessons learned and/or best practices that may be of interest to future workshops include:
−		+	:
−	:1. Regular Communication. Regular Executive Team and All-Leads meetings facilitated rapid recognition and removal of roadblocks, enabled agile reprioritization and redirection, and in general helped to maintain momentum of technical efforts. Holding these meetings every two weeks seemed to be the right frequency, and they were conducted effectively as teleconferences.	+	:1. <I>Regular Communication.</I> Regular Executive Team and All-Leads meetings facilitated rapid recognition and removal of roadblocks, enabled agile reprioritization and redirection, and in general helped to maintain momentum of technical efforts. Holding these meetings every two weeks seemed to be the right frequency, and they were conducted effectively as teleconferences.
−		+	:
−	:2. Distributed Leadership: By organizing the technical efforts into a set of subgroups with specific charters and respected, capable leaders, we were able to distribute our management responsibilities and push accountability for technical results down to the most qualified experts.	+	:2. <I>Distributed Leadership:</I> By organizing the technical efforts into a set of subgroups with specific charters and respected, capable leaders, we were able to distribute our management responsibilities and push accountability for technical results down to the most qualified experts.
−		+	:
−	:3. Temporally and Geographically Distributed Meetings. The bulk of the IKRIS technical efforts were conducted by participants working remotely from their home institutions, supported by electronic collaboration technology. This allowed us to take advantage of technical talent from across the USA and Canada, while keeping meeting costs to an acceptable level. We changed meeting venues to balance travel demands and costs equitably across the IKRIS participant community.	+	:3. <I>Temporally and Geographically Distributed Meetings.</I> The bulk of the IKRIS technical efforts were conducted by participants working remotely from their home institutions, supported by electronic collaboration technology. This allowed us to take advantage of technical talent from across the USA and Canada, while keeping meeting costs to an acceptable level. We changed meeting venues to balance travel demands and costs equitably across the IKRIS participant community.
−		+	:
−	:4. Suite of Remote Collaboration Tools. A suite of remote collaboration tools was needed to effectively support the distributed IKRIS team. E-mail distribution lists were essential; a searchable e-mail archive was requested early on, but it isn’t clear how extensively it was used. Toll-free teleconferencing support was also essential. Web conferencing services were not available until near the end of the workshop, but we suspect that they would have been heavily used if they had been available. MITRE’s document sharing system was also very useful, though it had rather complex mechanisms for user authentication, and reportedly did not work well on non-Windows computing platforms. So future workshops should make early provision for a suite of easy-to-use, platform-independent remote collaboration services.	+	:4. <I>Suite of Remote Collaboration Tools.</I> A suite of remote collaboration tools was needed to effectively support the distributed IKRIS team. E-mail distribution lists were essential; a searchable e-mail archive was requested early on, but it isn’t clear how extensively it was used. Toll-free teleconferencing support was also essential. Web conferencing services were not available until near the end of the workshop, but we suspect that they would have been heavily used if they had been available. MITRE’s document sharing system was also very useful, though it had rather complex mechanisms for user authentication, and reportedly did not work well on non-Windows computing platforms. So future workshops should make early provision for a suite of easy-to-use, platform-independent remote collaboration services.
−		+	:
−	:5. Highly engaged government champions. The government leads were very helpful in focusing, providing opportunities, contributing domain knowledge and experience, and overall cheerleading of the effort.	+	:5. <I>Highly engaged government champions.</i> The government leads were very helpful in focusing, providing opportunities, contributing domain knowledge and experience, and overall cheerleading of the effort.
	While every workshop is unique, we hope these lessons will be of use in making future workshops as effective as IKRIS.		While every workshop is unique, we hope these lessons will be of use in making future workshops as effective as IKRIS.
		+	</BLOCKQUOTE>

@@ Line 188: / Line 188: @@
 **	TTWG teleconference:  continued development of the Capstone Demonstration.
 **	MITRE presented a briefing on IKRIS at AFRL.  This identified some potential applications of IKRIS to emerging AFRL programs, and also yielded a contact to the “Semantic Web in the Intelligence Community” Group (SWIG).
-*	<I>March 2006:<I>
+*	<I>March 2006:</I>
 **	TTWG teleconference:  continued development of the Capstone Demonstration.
 **	MITRE presented a briefing at the Joint Warfare Analysis Center (JWAC, Dahlgren VA) to the “Semantic Web in the IC” Group (SWIG).  This yielded a lead to a DIA metadata program.

@@ Line 149: / Line 149: @@
   In addition to the administration of 21 subcontracts over two fiscal years, MITRE also provided meeting-planning support for all major IKRIS meetings, including the April 2005 kickoff meeting at the Columbia Hilton (Columbia MD), the work session during the June 2005 NIMD Principal Investigators Meeting (McLean VA), the work session during the November 2005 NIMD/ARIVA/Topsail Joint Principal Investigators Meeting (Orlando FL), the April 2006 IKRIS Community Meeting (Mountain View CA), and the Capstone Demo Meeting at IBM (Hawthorne NY) in September 2006.
-  To facilitate the technical execution of the IKRIS Challenge Workshop, MITRE established an access-controlled, Internet-accessible website for document sharing<super>2</super>,  a collection of archived e-mail distribution lists, a password-protected, Internet-accessible website for browsing the e-mail archives<sup>3</sup>,  and a public IKRIS website<sup>4</sup>.   MITRE’s toll-free teleconferencing system was used several times every month to support Executive team, All-Leads team, and regular Working Group technical sessions.  As IKRIS technical materials reached readiness for review outside the IKRIS community, MITRE worked with ARDA/DTO staff to review these materials for public release approval.  MITRE also served as “corresponding secretary” on behalf of IKRIS, responding to inquiries and managing access to the document repository.
+  To facilitate the technical execution of the IKRIS Challenge Workshop, MITRE established an access-controlled, Internet-accessible website for document sharing<sup>2</sup>,  a collection of archived e-mail distribution lists, a password-protected, Internet-accessible website for browsing the e-mail archives<sup>3</sup>,  and a public IKRIS website<sup>4</sup>.   MITRE’s toll-free teleconferencing system was used several times every month to support Executive team, All-Leads team, and regular Working Group technical sessions.  As IKRIS technical materials reached readiness for review outside the IKRIS community, MITRE worked with ARDA/DTO staff to review these materials for public release approval.  MITRE also served as “corresponding secretary” on behalf of IKRIS, responding to inquiries and managing access to the document repository.
   MITRE prepared and delivered monthly progress reports to the Government, and beginning in January 2006, met approximately monthly with the cognizant ARDA/DTO Program Manager to provide updates on IKRIS activities and accomplishments.

@@ Line 143: / Line 143: @@
 === 2	Summary of MITRE Support Activities (pg 8) ===
-  MITRE’s activities in support of the <b>IKRIS Challenge Workshop<b> fall into two categories: <i>administration/logistics</i>, and <i>direct technical</i>.  In this section we summarize MITRE’s activities and accomplishments in each category.
+  MITRE’s activities in support of the <b>IKRIS Challenge Workshop</b> fall into two categories: <i>administration/logistics</i>, and <i>direct technical</i>.  In this section we summarize MITRE’s activities and accomplishments in each category.
 ==== 2.1	Administration and Logistics Support (pg 8) ====
   As prime contractor, MITRE staff expended significant labor on subcontracting and contracts administration.  MITRE executed Basic Ordering Agreements (BOAs) with twelve (12) corporate entities, and each fiscal year (FY) executed Task Orders against these BOAs.  In addition, MITRE executed direct “consulting engineer” subcontracts with nine (9) researchers.  Over the course of each FY, MITRE solicited and processed invoices, and monitored budget performance.  As fiscal issues or opportunities arose, MITRE developed and executed action plans in coordination with the IKRIS TLs.