members@lists.national-coalition-literacy.org

National Coalition for Literacy Discussion List

View all threads

01.09.2019 NCL Policy Call

JM
Judy Mortrude
Wed, Jan 9, 2019 9:45 PM

Instant notes & a flyer eliciting information for the adult education effectiveness feasibility study.
Thanks all!
Judy

Instant notes & a flyer eliciting information for the adult education effectiveness feasibility study. Thanks all! Judy
DR
David Rosen
Sat, Jan 12, 2019 5:16 PM

HelloNCL Colleagues,

Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study.

This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project.

http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf

For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice:

"Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.”

This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective.

David

David J. Rosen
djrosen123@gmail.com

On Jan 9, 2019, at 4:45 PM, Judy Mortrude jmortrude@clasp.org wrote:

<IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>

HelloNCL Colleagues, Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study. This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project. http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf <http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf> For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice: "Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.” This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective. David David J. Rosen djrosen123@gmail.com > On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.org> wrote: > > <IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>
SB
Sharon Bonney
Tue, Jan 15, 2019 10:33 AM

David,
This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion.

Kindly,

Sharon Bonney
Executive Director
Coalition on Adult Basic Education
[cid:25190657-ba41-46b0-a40d-f35a51ba8c5b]

From: Members members-bounces@lists.national-coalition-literacy.org On Behalf Of David Rosen
Sent: Saturday, January 12, 2019 12:17 PM
To: Judy Mortrude jmortrude@clasp.org
Cc: Nation Coalition for Literacy members@lists.national-coalition-literacy.org
Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call

HelloNCL Colleagues,

Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study.

This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project.

http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf

For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice:

"Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.”

This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective.

David

David J. Rosen
djrosen123@gmail.commailto:djrosen123@gmail.com

On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.orgmailto:jmortrude@clasp.org> wrote:

<IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>

David, This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion. Kindly, Sharon Bonney Executive Director Coalition on Adult Basic Education [cid:25190657-ba41-46b0-a40d-f35a51ba8c5b] From: Members <members-bounces@lists.national-coalition-literacy.org> On Behalf Of David Rosen Sent: Saturday, January 12, 2019 12:17 PM To: Judy Mortrude <jmortrude@clasp.org> Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org> Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call HelloNCL Colleagues, Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study. This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project. http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice: "Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.” This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective. David David J. Rosen djrosen123@gmail.com<mailto:djrosen123@gmail.com> On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.org<mailto:jmortrude@clasp.org>> wrote: <IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>
JM
Judy Mortrude
Tue, Jan 15, 2019 2:57 PM

Sounds like an excellent idea!

Judy Mortrude . CLASP . office 202.906.8014 . mobile 651.276.7067 . clasp.org

From: Sharon Bonney sharonmbonney@coabe.org
Sent: Tuesday, January 15, 2019 5:33 AM
To: David Rosen djrosen123@gmail.com; Judy Mortrude jmortrude@clasp.org
Cc: Nation Coalition for Literacy members@lists.national-coalition-literacy.org
Subject: RE: [NCL Members] 01.09.2019 NCL Policy Call

David,
This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion.

Kindly,

Sharon Bonney
Executive Director
Coalition on Adult Basic Education
[cid:25190657-ba41-46b0-a40d-f35a51ba8c5b]

From: Members <members-bounces@lists.national-coalition-literacy.orgmailto:members-bounces@lists.national-coalition-literacy.org> On Behalf Of David Rosen
Sent: Saturday, January 12, 2019 12:17 PM
To: Judy Mortrude <jmortrude@clasp.orgmailto:jmortrude@clasp.org>
Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.orgmailto:members@lists.national-coalition-literacy.org>
Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call

HelloNCL Colleagues,

Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study.

This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project.

http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf

For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice:

"Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.”

This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective.

David

David J. Rosen
djrosen123@gmail.commailto:djrosen123@gmail.com

On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.orgmailto:jmortrude@clasp.org> wrote:

<IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>

Sounds like an excellent idea! Judy Mortrude . CLASP . office 202.906.8014 . mobile 651.276.7067 . clasp.org From: Sharon Bonney <sharonmbonney@coabe.org> Sent: Tuesday, January 15, 2019 5:33 AM To: David Rosen <djrosen123@gmail.com>; Judy Mortrude <jmortrude@clasp.org> Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org> Subject: RE: [NCL Members] 01.09.2019 NCL Policy Call David, This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion. Kindly, Sharon Bonney Executive Director Coalition on Adult Basic Education [cid:25190657-ba41-46b0-a40d-f35a51ba8c5b] From: Members <members-bounces@lists.national-coalition-literacy.org<mailto:members-bounces@lists.national-coalition-literacy.org>> On Behalf Of David Rosen Sent: Saturday, January 12, 2019 12:17 PM To: Judy Mortrude <jmortrude@clasp.org<mailto:jmortrude@clasp.org>> Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org<mailto:members@lists.national-coalition-literacy.org>> Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call HelloNCL Colleagues, Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study. This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project. http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice: "Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.” This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective. David David J. Rosen djrosen123@gmail.com<mailto:djrosen123@gmail.com> On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.org<mailto:jmortrude@clasp.org>> wrote: <IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>
CC
Clymer, Carol Dawn
Tue, Jan 15, 2019 3:02 PM

Agree!

On Jan 15, 2019, at 9:57 AM, Judy Mortrude <jmortrude@clasp.orgmailto:jmortrude@clasp.org> wrote:

Sounds like an excellent idea!

Judy Mortrude . CLASP . office 202.906.8014 . mobile 651.276.7067 . clasp.orghttp://clasp.org/

From: Sharon Bonney <sharonmbonney@coabe.orgmailto:sharonmbonney@coabe.org>
Sent: Tuesday, January 15, 2019 5:33 AM
To: David Rosen <djrosen123@gmail.commailto:djrosen123@gmail.com>; Judy Mortrude <jmortrude@clasp.orgmailto:jmortrude@clasp.org>
Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.orgmailto:members@lists.national-coalition-literacy.org>
Subject: RE: [NCL Members] 01.09.2019 NCL Policy Call

David,
This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion.

Kindly,

Sharon Bonney
Executive Director
Coalition on Adult Basic Education
[cid:25190657-ba41-46b0-a40d-f35a51ba8c5b]

From: Members <members-bounces@lists.national-coalition-literacy.orgmailto:members-bounces@lists.national-coalition-literacy.org> On Behalf Of David Rosen
Sent: Saturday, January 12, 2019 12:17 PM
To: Judy Mortrude <jmortrude@clasp.orgmailto:jmortrude@clasp.org>
Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.orgmailto:members@lists.national-coalition-literacy.org>
Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call

HelloNCL Colleagues,

Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study.

This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project.

http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdfhttps://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.ncsall.net%2Ffileadmin%2Fresources%2Fresearch%2Fop_comings3.pdf&data=02%7C01%7Ccdc22%40psu.edu%7Cb810d0761c9a4fbd0b3608d67af9f1d1%7C7cf48d453ddb4389a9c1c115526eb52e%7C0%7C0%7C636831611268864534&sdata=6TvWlMIkGyuNuYt4gwHKpJbsrN26avV2Hb0pnpNtFJU%3D&reserved=0

For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice:

"Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.”

This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective.

David

David J. Rosen
djrosen123@gmail.commailto:djrosen123@gmail.com

On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.orgmailto:jmortrude@clasp.org> wrote:

<IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>


National Coalition for Literacy Members mailing list
Members@lists.national-coalition-literacy.orgmailto:Members@lists.national-coalition-literacy.org
To unsubscribe: https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.national-coalition-literacy.org%2Fmailman%2Flistinfo%2Fmembers_lists.national-coalition-literacy.org&data=02%7C01%7Ccdc22%40psu.edu%7Cb810d0761c9a4fbd0b3608d67af9f1d1%7C7cf48d453ddb4389a9c1c115526eb52e%7C0%7C0%7C636831611268884545&sdata=OEaKkbMBHpt2qhsS1hwMmTXcBK4wnQ5CdbXxZTtEbuQ%3D&reserved=0

Carol Clymer, Ed.D.
Co-Director
Institute for the Study of Adult Literacy
https://ed.psu.edu/isal
Goodling Institute for Research in Family Literacy
https://ed.psu.edu/goodling-institute
403 B Keller Building
Penn State University
University Park, PA 16802
(814) 865-5876
(814) 863-6108 (fax)
email: cdc22@psu.edumailto:cdc22@psu.edu

Agree! On Jan 15, 2019, at 9:57 AM, Judy Mortrude <jmortrude@clasp.org<mailto:jmortrude@clasp.org>> wrote: Sounds like an excellent idea! Judy Mortrude . CLASP . office 202.906.8014 . mobile 651.276.7067 . clasp.org<http://clasp.org/> From: Sharon Bonney <sharonmbonney@coabe.org<mailto:sharonmbonney@coabe.org>> Sent: Tuesday, January 15, 2019 5:33 AM To: David Rosen <djrosen123@gmail.com<mailto:djrosen123@gmail.com>>; Judy Mortrude <jmortrude@clasp.org<mailto:jmortrude@clasp.org>> Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org<mailto:members@lists.national-coalition-literacy.org>> Subject: RE: [NCL Members] 01.09.2019 NCL Policy Call David, This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion. Kindly, Sharon Bonney Executive Director Coalition on Adult Basic Education [cid:25190657-ba41-46b0-a40d-f35a51ba8c5b] From: Members <members-bounces@lists.national-coalition-literacy.org<mailto:members-bounces@lists.national-coalition-literacy.org>> On Behalf Of David Rosen Sent: Saturday, January 12, 2019 12:17 PM To: Judy Mortrude <jmortrude@clasp.org<mailto:jmortrude@clasp.org>> Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org<mailto:members@lists.national-coalition-literacy.org>> Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call HelloNCL Colleagues, Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study. This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project. http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.ncsall.net%2Ffileadmin%2Fresources%2Fresearch%2Fop_comings3.pdf&data=02%7C01%7Ccdc22%40psu.edu%7Cb810d0761c9a4fbd0b3608d67af9f1d1%7C7cf48d453ddb4389a9c1c115526eb52e%7C0%7C0%7C636831611268864534&sdata=6TvWlMIkGyuNuYt4gwHKpJbsrN26avV2Hb0pnpNtFJU%3D&reserved=0> For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice: "Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.” This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective. David David J. Rosen djrosen123@gmail.com<mailto:djrosen123@gmail.com> On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.org<mailto:jmortrude@clasp.org>> wrote: <IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf> _______________________________________________ National Coalition for Literacy Members mailing list Members@lists.national-coalition-literacy.org<mailto:Members@lists.national-coalition-literacy.org> To unsubscribe: https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.national-coalition-literacy.org%2Fmailman%2Flistinfo%2Fmembers_lists.national-coalition-literacy.org&amp;data=02%7C01%7Ccdc22%40psu.edu%7Cb810d0761c9a4fbd0b3608d67af9f1d1%7C7cf48d453ddb4389a9c1c115526eb52e%7C0%7C0%7C636831611268884545&amp;sdata=OEaKkbMBHpt2qhsS1hwMmTXcBK4wnQ5CdbXxZTtEbuQ%3D&amp;reserved=0 Carol Clymer, Ed.D. Co-Director Institute for the Study of Adult Literacy https://ed.psu.edu/isal Goodling Institute for Research in Family Literacy https://ed.psu.edu/goodling-institute 403 B Keller Building Penn State University University Park, PA 16802 (814) 865-5876 (814) 863-6108 (fax) email: cdc22@psu.edu<mailto:cdc22@psu.edu>
DR
David Rosen
Tue, Jan 15, 2019 3:13 PM

Judy and others,

I have contacted the Open Door Collective Steering Committee, copied here, to see if we could organize this meeting. The Open Door Collective has over 30 members attending the COABE Conference, many of whom are researchers or who have shown an interest in research. If we take this on, it would of course be a meeting open to all COABE members attending the conference.

David

David J. Rosen
djrosen123@gmail.com

On Jan 15, 2019, at 9:57 AM, Judy Mortrude jmortrude@clasp.org wrote:

Sounds like an excellent idea!

Judy Mortrude . CLASP . office 202.906.8014 . mobile 651.276.7067 . clasp.org http://clasp.org/

From: Sharon Bonney <sharonmbonney@coabe.org mailto:sharonmbonney@coabe.org>
Sent: Tuesday, January 15, 2019 5:33 AM
To: David Rosen <djrosen123@gmail.com mailto:djrosen123@gmail.com>; Judy Mortrude <jmortrude@clasp.org mailto:jmortrude@clasp.org>
Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org mailto:members@lists.national-coalition-literacy.org>
Subject: RE: [NCL Members] 01.09.2019 NCL Policy Call

David,
This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion.

Kindly,

Sharon Bonney
Executive Director
Coalition on Adult Basic Education
<image001.jpg>

From: Members <members-bounces@lists.national-coalition-literacy.org mailto:members-bounces@lists.national-coalition-literacy.org> On Behalf Of David Rosen
Sent: Saturday, January 12, 2019 12:17 PM
To: Judy Mortrude <jmortrude@clasp.org mailto:jmortrude@clasp.org>
Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org mailto:members@lists.national-coalition-literacy.org>
Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call

HelloNCL Colleagues,

Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study.

This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project.

http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf

For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice:

"Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.”

This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective.

David

David J. Rosen
djrosen123@gmail.com mailto:djrosen123@gmail.com

On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.org mailto:jmortrude@clasp.org> wrote:

<IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>

Judy and others, I have contacted the Open Door Collective Steering Committee, copied here, to see if we could organize this meeting. The Open Door Collective has over 30 members attending the COABE Conference, many of whom are researchers or who have shown an interest in research. If we take this on, it would of course be a meeting open to all COABE members attending the conference. David David J. Rosen djrosen123@gmail.com > On Jan 15, 2019, at 9:57 AM, Judy Mortrude <jmortrude@clasp.org> wrote: > > Sounds like an excellent idea! > > Judy Mortrude . CLASP . office 202.906.8014 . mobile 651.276.7067 . clasp.org <http://clasp.org/> > > From: Sharon Bonney <sharonmbonney@coabe.org <mailto:sharonmbonney@coabe.org>> > Sent: Tuesday, January 15, 2019 5:33 AM > To: David Rosen <djrosen123@gmail.com <mailto:djrosen123@gmail.com>>; Judy Mortrude <jmortrude@clasp.org <mailto:jmortrude@clasp.org>> > Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org <mailto:members@lists.national-coalition-literacy.org>> > Subject: RE: [NCL Members] 01.09.2019 NCL Policy Call > > David, > This is excellent and still relevant 16 years after the paper was published. It would be wonderful if we could come together as field to build an evidence-based adult education system. This has been a recent topic of discussion with a number of our colleagues here at COABE. I would love to see this conversation continue at the COABE 2019 conference in New Orleans, LA March 31-April 3rd. We can provide a meeting space if folks are interested in continuing the discussion. > > Kindly, > > Sharon Bonney > Executive Director > Coalition on Adult Basic Education > <image001.jpg> > > > > > > > > > From: Members <members-bounces@lists.national-coalition-literacy.org <mailto:members-bounces@lists.national-coalition-literacy.org>> On Behalf Of David Rosen > Sent: Saturday, January 12, 2019 12:17 PM > To: Judy Mortrude <jmortrude@clasp.org <mailto:jmortrude@clasp.org>> > Cc: Nation Coalition for Literacy <members@lists.national-coalition-literacy.org <mailto:members@lists.national-coalition-literacy.org>> > Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call > > HelloNCL Colleagues, > > Here is a follow-up to our Wednesday January 9th NCL Public Policy Committee meeting item on the Mathematica Assessing Evidence of Effectiveness in Adult Education: Design Study. > > This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and Cristine Smith may be helpful in informing NCL recommendations to Mathematica for its "Assessing Evidence of Effectiveness in Adult Education: Design Study" project. > > http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf <http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf> > > For example, the section on Building an Evidence-based Adult Education System, page 10, has this advice: > > "Research and evaluation should take place within programs that meet some basic criteria for good design. These criteria define baseline program models. An evidence-based adult education system should start with the identification and evaluation of baseline program models that conform to the existing empirical evidence and practitioner knowledge. Since the existing evidence from basic and applied research and program model evaluation is insufficient to be the sole source of program model design, practitioner knowledge is critical to filling in the existing gaps. Baseline program model evaluations would establish a place from which to begin improvement.” > > This recommendation offers an approach to prevent using an (expensive) experimental design study to measure the effect of a program model that does not have sufficient preliminary empirical evidence of being effective. > > David > > David J. Rosen > djrosen123@gmail.com <mailto:djrosen123@gmail.com> > > > On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.org <mailto:jmortrude@clasp.org>> wrote: > > <IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>
SK
Silja Kallenbach
Wed, Jan 16, 2019 1:18 PM

Good idea! I was always an advocate for the approach that paper
recommends.  I don’t know of any adult ed public funder that has followed
these recommendations. Does anyone?
Silja

On Tue, Jan 15, 2019 at 10:13 AM David Rosen djrosen123@gmail.com wrote:

Judy and others,

I have contacted the Open Door Collective Steering Committee, copied here,
to see if we could organize this meeting. The Open Door Collective has over
30 members attending the COABE Conference, many of whom are researchers or
who have shown an interest in research. If we take this on, it would of
course be a meeting open to all COABE members attending the conference.

David

David J. Rosen
djrosen123@gmail.com

On Jan 15, 2019, at 9:57 AM, Judy Mortrude jmortrude@clasp.org wrote:

Sounds like an excellent idea!

Judy Mortrude . CLASP . office 202.906.8014 . mobile 651.276.7067 .
clasp.org

From: Sharon Bonney sharonmbonney@coabe.org
Sent: Tuesday, January 15, 2019 5:33 AM
To: David Rosen djrosen123@gmail.com; Judy Mortrude <
jmortrude@clasp.org>
Cc: Nation Coalition for Literacy <
members@lists.national-coalition-literacy.org>
Subject: RE: [NCL Members] 01.09.2019 NCL Policy Call

David,
This is excellent and still relevant 16 years after the paper was
published. It would be wonderful if we could come together as field to
build an evidence-based adult education system. This has been a recent
topic of discussion with a number of our colleagues here at COABE. I would
love to see this conversation continue at the COABE 2019 conference in New
Orleans, LA March 31-April 3rd. We can provide a meeting space if folks
are interested in continuing the discussion.

Kindly,

Sharon Bonney
Executive Director
Coalition on Adult Basic Education
<image001.jpg>

From: Members members-bounces@lists.national-coalition-literacy.org *On
Behalf Of *David Rosen
Sent: Saturday, January 12, 2019 12:17 PM
To: Judy Mortrude jmortrude@clasp.org
Cc: Nation Coalition for Literacy <
members@lists.national-coalition-literacy.org>
Subject: Re: [NCL Members] 01.09.2019 NCL Policy Call

HelloNCL Colleagues,

Here is a follow-up to our Wednesday January 9th NCL Public Policy
Committee meeting item on the Mathematica Assessing Evidence of
Effectiveness in Adult Education: Design Study.

This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and
Cristine Smith may be helpful in informing NCL recommendations to
Mathematica for its "Assessing Evidence of Effectiveness in Adult
Education: Design Study" project.

http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf

For example, the section on Building an Evidence-based Adult Education
System, page 10, has this advice:

"Research and evaluation should take place within programs that meet some
basic criteria for good design. These criteria define baseline program
models. An evidence-based adult education system should start with the
identification and evaluation of baseline program models that conform to
the existing empirical evidence and practitioner knowledge. Since the
existing evidence from basic and applied research and program model
evaluation is insufficient to be the sole source of program model design,
practitioner knowledge is critical to filling in the existing gaps.
Baseline program model evaluations would establish a place from which to
begin improvement.”

This recommendation offers an approach to prevent using an (expensive)
experimental design study to measure the effect of a program model that
does not have sufficient preliminary empirical evidence of being effective.

David

David J. Rosen
djrosen123@gmail.com

On Jan 9, 2019, at 4:45 PM, Judy Mortrude jmortrude@clasp.org wrote:

<IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf>


National Coalition for Literacy Members mailing list
Members@lists.national-coalition-literacy.org
To unsubscribe:
http://lists.national-coalition-literacy.org/mailman/listinfo/members_lists.national-coalition-literacy.org

--

.
Silja kallenbach [image: Red Squares]Vice President [image: Red Squares]
617.482.9485
www.worlded.org [image: JSILogo] http://www.facebook.com/worlded [image:
JSILogo] http://www.twitter.com/worlded

Good idea! I was always an advocate for the approach that paper recommends. I don’t know of any adult ed public funder that has followed these recommendations. Does anyone? Silja On Tue, Jan 15, 2019 at 10:13 AM David Rosen <djrosen123@gmail.com> wrote: > Judy and others, > > I have contacted the Open Door Collective Steering Committee, copied here, > to see if we could organize this meeting. The Open Door Collective has over > 30 members attending the COABE Conference, many of whom are researchers or > who have shown an interest in research. If we take this on, it would of > course be a meeting open to all COABE members attending the conference. > > David > > David J. Rosen > djrosen123@gmail.com > > On Jan 15, 2019, at 9:57 AM, Judy Mortrude <jmortrude@clasp.org> wrote: > > Sounds like an excellent idea! > > *Judy Mortrude* . CLASP . office 202.906.8014 . mobile 651.276.7067 . > clasp.org > > *From:* Sharon Bonney <sharonmbonney@coabe.org> > *Sent:* Tuesday, January 15, 2019 5:33 AM > *To:* David Rosen <djrosen123@gmail.com>; Judy Mortrude < > jmortrude@clasp.org> > *Cc:* Nation Coalition for Literacy < > members@lists.national-coalition-literacy.org> > *Subject:* RE: [NCL Members] 01.09.2019 NCL Policy Call > > David, > This is excellent and still relevant 16 years after the paper was > published. It would be wonderful if we could come together as field to > build an evidence-based adult education system. This has been a recent > topic of discussion with a number of our colleagues here at COABE. I would > love to see this conversation continue at the COABE 2019 conference in New > Orleans, LA March 31-April 3rd. We can provide a meeting space if folks > are interested in continuing the discussion. > > Kindly, > > Sharon Bonney > Executive Director > Coalition on Adult Basic Education > *<image001.jpg>* > > > > > > > > > > *From:* Members <members-bounces@lists.national-coalition-literacy.org> *On > Behalf Of *David Rosen > *Sent:* Saturday, January 12, 2019 12:17 PM > *To:* Judy Mortrude <jmortrude@clasp.org> > *Cc:* Nation Coalition for Literacy < > members@lists.national-coalition-literacy.org> > *Subject:* Re: [NCL Members] 01.09.2019 NCL Policy Call > > HelloNCL Colleagues, > > Here is a follow-up to our Wednesday January 9th NCL Public Policy > Committee meeting item on the Mathematica Assessing Evidence of > Effectiveness in Adult Education: Design Study. > > This 2003 Paper by John Comings, Hal Beder, Steve Reder, Beth Bingman and > Cristine Smith may be helpful in informing NCL recommendations to > Mathematica for its "Assessing Evidence of Effectiveness in Adult > Education: Design Study" project. > > http://www.ncsall.net/fileadmin/resources/research/op_comings3.pdf > > For example, the section on Building an Evidence-based Adult Education > System, page 10, has this advice: > > "Research and evaluation should take place within programs that meet some > basic criteria for good design. These criteria define baseline program > models. An evidence-based adult education system should start with the > identification and evaluation of baseline program models that conform to > the existing empirical evidence and practitioner knowledge. Since the > existing evidence from basic and applied research and program model > evaluation is insufficient to be the sole source of program model design, > practitioner knowledge is critical to filling in the existing gaps. > Baseline program model evaluations would establish a place from which to > begin improvement.” > > This recommendation offers an approach to prevent using an (expensive) > experimental design study to measure the effect of a program model that > does not have sufficient preliminary empirical evidence of being effective. > > David > > David J. Rosen > djrosen123@gmail.com > > > > On Jan 9, 2019, at 4:45 PM, Judy Mortrude <jmortrude@clasp.org> wrote: > > <IES_Assess Effectiveness_Adult Ed_1 pager_110818.pdf> > > > _______________________________________________ > National Coalition for Literacy Members mailing list > Members@lists.national-coalition-literacy.org > To unsubscribe: > http://lists.national-coalition-literacy.org/mailman/listinfo/members_lists.national-coalition-literacy.org > -- . Silja kallenbach [image: Red Squares]Vice President [image: Red Squares] 617.482.9485 www.worlded.org [image: JSILogo] <http://www.facebook.com/worlded> [image: JSILogo] <http://www.twitter.com/worlded>