Action Review for Outcome (a) Apply knowledge of math, science,
and engineering |
2004 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
There was no specific Curriculum Action specified at the end of 2003 for
Outcome (a) during 2004. |
Curriculum
Review Summary |
|
|
|
|
Outcome (a) scores increased from 2003
to 2004. |
Outcome (a) score variation among the three metrics decreased from 2003 to
2004 |
Outcome (a) assessment indicates improving
student performance but statistical variation in the assessment process has
not been established. |
No Action is needed at this time. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
N |
|
|
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
Seeking better instruments for Outcome (a) were suggested as an Assessment
Process Action at the end of 2003 for Outcome (a) during 2004. Instruments
were the specific target, not metrics. |
Assessment
Process Review Summary |
|
|
|
|
The instruments for Outcome (a) seem to be functioning better than thought at
the end of 2003. The Assessment
Process Action for 2004 in retrospect was not a significant need; however,
there remains an interest in moving to more objective measures of student
performance using somewhat standardized Instruments. |
A method of using the FE Exam results for the assessment of many of the
Outcomes, including (a) has been developed and implemented. |
The use of questions on MET 320 and MATH
373 final exams is being considered for implementation. More objective measures are needed. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
A |
Better
Assessment of Outcome (a) |
Develop
more objective instruments to assess Outcome (a). |
|
|
|
|
|
|
2005 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
There were no 2005 Curriculum Actions Needed. |
Curriculum
Review Summary |
|
|
|
|
Outcome (a) scores increased from 2004 to 2005. |
Outcome (a) score variation among the three metrics increased somewhat in
2005 compared to 2004. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
N |
|
|
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
The Assessment Process Actions for Outcome (a) for 2005 was the general
action that all faculty members consider producing metrics that provide for
more reliable measures of student achievement. This has taken the form of more objective
measures as acquired through the Senior Exit Survey and the FE Exam. |
Assessment
Process Review Summary |
|
|
|
|
The current cadre of instruments appears to be good tools for assessing
Outcome (a). |
The faculty are again asked to continually seek better measures of student
performance. |
The Senior Survey is an excellent assessment instrument in that objective
(faculty play no role in determining the assessment score) results are
obtained. |
A Senior Exit Exam would be an excellent
improvement that it would yield objective results in that the faculty would
play no role in determining the assessment scores. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
A |
Develop a
Senior Exit Exam |
A
Senior Exit Exam is needed to achieve better Assessment of Outcome (c ). |
|
|
|
|
|
|
2006 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
There were no 2005 Curriculum Actions stated for 2006. |
Curriculum
Review Summary |
|
|
|
|
Outcome (a) scores decreased from 2005 to 2006. |
Outcome (a) score variation among the three metrics increased from 2005 to
2006 |
The decrease in student performance may be within the statistical variation
for measuring Outcome (a); however, curriculum improvements are
beneficial. To this end an improved
and expanded textbook authored by the course instructor for MATH 373 will be
introduced in 2007. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
A |
New Textbook
for MATH 373 |
A new
textbook for MATH 373 that addresses all the topics covered in the course,
unlike current textbooks, will be written and introduced. |
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
A
need for improved Assessment Process for Outcome (c ) in the form of a Senior
Exit Exam is an ongoing process improvement.
Dr Howard will assume responsibility for coordinating this effort. |
Assessment
Process Review Summary |
|
|
|
|
The current cadre of instruments appears to be good tools for assessing
Outcome (a). The faculty are again
asked to continually seek better measures of student performance. |
The current Assessment Processes should be continued to assess Outcome (a),
but other objective assessment data are needed. |
A Senior Exam should be developed as was recommended last year. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
A |
Local Senior
Exit Exam |
Develop
a Senior Exit Exam to be administered to seniors as they near graduation so
as to gain objective assessment results specifically covering as many metrics
as possible. |
|
|
|
|
|
|
2007 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
The Curriculum Action caling for the introduction of a new textbook for MATH
373 was completed in 2007. |
Curriculum
Review Summary |
|
|
|
|
The scores for Outcome (a) remained the
same for 2007 as for 2006. |
New program faculty could benefit from
mentoring and better integration with experienced faculty more familiar with
the interfaces within the curriculum.
Faculty training and mentoring could have sigificant affects on
student performance. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
A |
New Faculty
Curriculum Mentoring and Training |
New
faculty mentoring and training for the classroom and curriculum interfaces is
needed. |
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
The 2006 Assessment Process Actions Needed called for the development and
implimentation of a Local Senior Exit Exam, now termed the Local Exam given
to all seniors as they near graduation (usually during their last few weeks
of course work). This action was completed during the year and is used for
many Outcomes including Outcome (a).
It is an excellent objective measurement. |
Assessment
Process Review Summary |
|
|
|
|
The drop in scores from 2005 and 2006 may be related to different reviewers
as faculty turnovers occur. Faculty
training in the Continuous Improvement Process is essential and should
continue with renewed emphasis. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
A |
New Faculty
Continuous Process Training |
New
faculty will be trained in the program's Continuous Improvement assessment
processes and practices. |
|
|
|
|
|
|
2008 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
As suggested for 2008, new faculty have undergone mentoring and training for
the classroom and curriculum interfaces. |
Curriculum
Review Summary |
|
|
|
|
Student assessment of performance continues to decline. The new faculty integration and training is
expected to show improved studetnt performance so no Curriculum Action is
recommended. |
Faculty training and mentoring is an ongoing departmental process and will no
longer be mentioned specifically. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
N |
|
|
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
As suggested for 2007, new faculty have undergone training in the program's
Continuous Improvement assessment processes and practices. |
Assessment
Process Review Summary |
|
|
|
|
Student performance continues to decline.
This may be the result of the assessed cohort's academic variation
with the academically superior 2005/6 cohort.
This suggests the possible normalization of outcome assessment results
with cohort GPA's; however, that data is not readily available to the program
from institutional databases. |
The most likely cause for performance decline is the recent turnover in
program faculty. |
A watch of performance is warranted.
If improvement is not seen in the coming year, action will be
needed.
Watch to see if the Senior Exit Exam (Local Exam) results are
considerable different from the other instruments and if it variation is less
than other metrics. Also consider if
cohort GPA is reflected in the Exit Exam results.
Faculty training and mentoring is an ongoing departmental process
and will no longer be mentioned specifically. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
W |
Senior Exit
Exam |
Determine
if the Senior Exit Exam has less variation from year to year and how it
compares with other metrics results. |
C |
Continued Faculty Training and
Mentoring |
New faculty are being
trained in the program's Continuous Improvement assessment processes and
practices. |
|
|
|
|
|
|
2009 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
No
Previous Curriculum Action Review Items were noted |
Curriculum
Review Summary |
|
|
|
|
Mean
student performance improved from 2008 to 2009, while the variation between
instruments was considerably reduced. |
A |
MATH 373 |
Replace
MATH 373 |
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
Two
Previous Assessment Process Action items were noted, a watch on the variation
in the senior exit exam and a continuation action concerning faculty
training. |
Assessment
Process Review Summary |
|
|
|
|
As
previously, all student assessments for the local exam were the same. They were all very good, but with no
variation. This may indicate some
changes in questions or how the scores are apportioned is needed. |
No results were returned for MATH 373. |
MATH
373 has ceased being a useful assessment tool since SMH no longer controls
the related instruments. |
Scores have stabilized so the extra faculty training is likely
having an effect |
A |
MATH
373 |
Replace
or remove MATH 373 instruments |
W |
Local Exam |
Variability
within instrument still low |
|
|
|
|
|
|
2010 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
|
Mean
student performance improved from 2008 to 2009, while the variation between
instruments was considerably reduced. |
Curriculum
Review Summary |
|
|
|
|
Math
373 was removed and not considered as an assessment tool for 2010. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
|
N |
|
|
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
As
previously, all student assessments for the local exam were the same. They were all very good, but with no
variation. This may indicate some
changes in questions or how the scores are apportioned is needed. |
No results were returned for MATH 373. |
MATH
373 has ceased being a useful assessment tool since SMH no longer controls
the related instruments. |
Scores have stabilized so the extra faculty training is likely having an
effect |
Assessment
Process Review Summary |
|
|
|
|
MATH
373 has been removed. Significant variability in 2010 was observed. However,
much of the variability can be related to less number of students taking the
FE Exam. So the watch has been removed. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
N |
|
|
|
|
|
|
|
|
2011 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
|
Math
373 was removed and not considered as an assessment tool for 2010. |
Curriculum
Review Summary |
|
|
|
|
The
outcome review scores were consistent with the previous year and therefore no
action is needed. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
|
N |
|
|
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
MATH
373 has been removed. Significant variability in 2010 was observed. However,
much of the variability can be related to less number of students taking the
FE Exam. So the watch has been removed. |
Assessment
Process Review Summary |
|
|
|
|
The
variability in 2011 has been decreased when compared to previous year.
Therefore no action is needed. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
N |
|
|
|
|
|
|
|
|
2012 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
|
The
outcome review scores were consistent with the previous year and therefore no
action is needed. |
Curriculum
Review Summary |
|
|
|
|
The
outcome review scores were consistent with the previous year. Therefore no
action is needed |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
|
N |
|
|
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
The
variability in 2011 has been decreased when compared to previous year.
Therefore no action is needed. |
Assessment
Process Review Summary |
|
|
|
|
The
variability has been decreased when compared to 2011. Much of the variability
can be related to number of students taking the FE Exam. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
N |
|
|
|
|
|
|
|
|
2013 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
|
The
outcome review scores were consistent with the previous year. Therefore no
action is needed |
Curriculum
Review Summary |
|
|
|
|
The
outcome review scores were consistent with 2012; therefore, no action is
needed. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
|
N |
No Action |
|
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
The
variability has been decreased when compared to 2011. Much of the variability
can be related to number of students taking the FE Exam. |
Assessment
Process Review Summary |
|
|
|
|
The average of 3.50 was the same as the
previous year. There seems to be a
trend downwards; however, one reviewer scored student performance
particularly low in one course. It is
recommended that a watch be placed on this item to determine if the low
ratings remain reviewer specific and if so then seek more uniform assesment
methods. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
W |
Instrument
Scoring Variability |
Determine
if the the MET 330 instrument yields low scores in 2015. |
|
|
|
|
|
|
2014 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
|
The
outcome review scores were consistent with 2012; therefore, no action is
needed. |
Curriculum
Review Summary |
|
|
|
|
The
average score has dropped to 3.3 from 3.50.
This drop is reflected in the non-subjective Exit exam scores,
too. Therefore, it appears to be a
real decrease unrelated to reviewer subjectness. Some Action is needed to determine the
cause of this decrease. One item that
should be reviewed is average class GPA. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
|
A |
Improve Exit
Exam adminstration |
Administer
Exit exam in a more formal setting so as to demonstrate its importance to the
students. |
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
The average of 3.50 was the same as the
previous year. There seems to be a
trend downwards; however, one reviewer scored student performance
particularly low in one course. It is
recommended that a watch be placed on this item to determine if the low
ratings remain reviewer specific and if so then seek more uniform assesment
methods. |
Assessment
Process Review Summary |
|
|
|
|
Continue
the Watch from 2013 per 2-year cohort system. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
W |
Instrument
Scoring Variability |
MET
330 exam reviews appear lower. This
may be because of new faculty teaching MET 330. Watch for consistency of MET 330
instruments. |
|
|
|
|
|
|
2015 |
|
|
|
|
|
Previous
Curriculum Action Review Summary |
|
|
|
|
The
average score has dropped to 3.3 from 3.50.
This drop is reflected in the non-subjective Exit exam scores,
too. Therefore, it appears to be a
real decrease unrelated to reviewer subjectness. Some Action is needed to determine the
cause of this decrease. One item that
should be reviewed is average class GPA. |
Curriculum
Review Summary |
|
|
|
|
The average score has remained low and is reflected in the
non-subjective decreasing Senior Exit Exam scores from 2010 to 2015: 4.67,
4.71, 4.60, 3.78, 3.55, 3.67. It seems
very unlikely this drop is the result of variations in student learning but
rather because something has changed in the assessment methodology. Therefore, action is focused on assessment
processes. Otherwise, a review of
basic (Freshman & Sophomore)science and math instruction will be needed
but only if other programs note the same decrease. |
Code |
Curriculum Action Title |
Curriculum Action Brief
Description |
|
|
W |
Low a) watch |
If
there is no improvement in a) assessments, a review of instructional methods
is needed. |
|
|
|
|
|
|
Previous
Assessment Process Action Review Summary |
|
|
|
Continue
the Watch from 2013 per 2-year cohort system. |
Assessment
Process Review Summary |
|
|
|
|
The
results from MET 330 remain significantly lower than from other
instruments. Conduct training and
review on a) Metrics for faculty members. |
Code |
Assessment Process Action Title |
Assessment Process Action
Brief Description |
|
A |
Metrics
Training and Review |
Conduct
a comparative review of a) outcome metrics and procedures. |
A |
Increase Senior
Exam Prestige |
Move
the exit exam to earlier in the semester and have the Dept Head administer
the testing. |
|
|
|
|
|
|