This Rubric is intended to help the CSE program
evaluate the extent to which various intended outcomes of the capstone
courses are achieved and help identify possible improvements to the program.
Visitors to the Capstone Showcase session are requested to
complete a separate copy of this rubric for each CSE project poster
that they spend time
examining and, especially, the ones for which they interact with one or more
of the team members and/or listen to the team member(s) explaining aspects of
the project or answering questions about the project.
Please leave
the completed rubrics in the CSE Rubrics box near the front of the
room. Thanks!
(More complete details about the
CSE capstone courses are available at
http://web.cse.ohio-state.edu/~neelam/abet/DIRASSMNT/capstoneFinalPres.pdf.)
Each CSE capstone project is evaluated along six dimensions below. The first four are concerned with the quality of the design/implementation work that the particular capstone team has engaged in during the semester. The fifth dimension concerns how well the individual students in the team came together to perform as a cohesive project team. The sixth dimension evaluates the effectiveness of the poster as well as the responses provided by the team members to questions from the visitors to the Capstone Showcase session in communicating the essential problem that the project undertook to solve, the approaches it tried and rejected/adopted, the design the team ultimately adopted and the rationale for it, as well as the lessons learned that might be of value in their own future careers as well as help future capstone project teams. (It may be worth noting that the last dimension, effectiveness of communication, is the most critical one as far as the Showcase is concerned because most visitors will not know anything about any (or most) of the capstone projects before the Showcase; whatever they will learn about any of the projects will be whatever they can get from the respective posters and from listening to the team members address any of the visitors and answer any questions. Nevertheless, the expectation is that the poster, by itself, given that the team would have had several days to work on it and would have benefited from feedback from the instructor on early drafts of it, will provide sufficient information about the project as to enable the Showcase visitors to arrive at informed assessments of the other five dimensions as well.)
In the table below, for each of the six dimensions, there is a description of the characteristics related to that dimension that are expected of the capstone team, its work on the project during the semester, the content of the poster prepared by the team, and the interactions between the team members and visitors to the poster session. The visitor to the poster session is asked to consider the following statement for each dimension: "Based on what I saw and heard at the poster session, this project team exhibited, in an exemplary manner, all or most of the characteristics corresponding to this dimension"; and then choose one of "Strongly Agree", "Agree", "Disagree", or "Strongly Disagree". It is admittedly difficult for a visitor to the Capstone Showcase poster session to get more than a very high-level idea of the team's work on the project, how effectively the members worked as a cohesive and effective team on the project, etc. Nevertheless, these assessments are an important part of the CSE program's continuous improvement efforts and we thank the visitors for completing this rubric. If the visitor completing the form has any specific comments related to any of the six dimensions, they may be entered in the line immediately below the particular dimension. Note that I have repeated this paragraph at the start of the table below; I am not sure whether it would be better to have the paragraph here or in the table below; suggestions?
In discussions, among Jeremy Morris, Al Cline, and Neelam Soundarajan,
as this rubric was being developed, it was suggested that the actual rubric
that is given to the visitors to the poster session should omit all this
preliminary material and start with the code of the project being evaluated.
Such a rubric has been prepared and is available
here.
Code of CSE capstone project being evaluated (to be filled in by a member of the project team before giving the form to the visitor): ________________________
Information about the person completing this rubric (check all that apply):
CSE/CIS student
non-CSE/CIS student
CSE faculty member
non-CSE faculty member
CS/IT professional
other (______________)
Below, for each of the six dimensions, there is a description of the corresponding characteristics that are expected of the ideal capstone team and its work. The visitor to the poster session is asked to consider the following statement for each dimension: "Based on what I saw and heard at the poster session, this project team exhibited, in an exemplary manner, all or most of the characteristics corresponding to this dimension"; and then choose one of "Strongly Agree", "Agree", "Disagree", or "Strongly Disagree" (or "Not Applicable" if the item is not relevant to the particular project). If the visitor completing the form has any specific comments related to any of the six dimensions, they may be entered in the line immediately below the particular dimension. These assessments are an important part of the CSE program's continuous improvement efforts and we thank the visitors for completing this rubric. | ||
Dimension | Characteristics expected of the (ideal) capstone project/team | |
---|---|---|
Problem Formulation | The team had come up with a clear formulation of
the problem
based on the sponsor's goals; any changes in the project's scope were clearly
explained and justified.
Strongly Agree Agree Disagree Strongly Disagree Not Applicable | |
Comments:
| ||
Design Approach | The team has produced a high-quality design that,
for the most part, meets the sponsor's goals; in doing so, the team has
gone through a suitable iterative process considering various alternatives,
including relevant resource (memory, bandwidth etc.) implications.
Strongly Agree Agree Disagree Strongly Disagree Not Applicable | |
Comments:
| ||
Implementation Approach** | The team has paid careful attention to all key
performance factors that may affect the system. The team has also considered
scalability issues as well as possible evolution of the system to meet
changing needs. The team has, in its implementation (or plans for it), applied
important lessons from key courses in the curriculum; and it has adopted and
consistently followed a standard process.
Strongly Agree Agree Disagree Strongly Disagree Not Applicable | |
**Note: Occasionally, because of the nature of the project or its starting point or changes that the sponsor may decide on midway through the semester or some combination of thereof, it may not be possible for the team to do a complete implementation. If this project does not have a complete implementation, in evaluating this dimension, please do so on the basis of briefly discussing, with the team, their implementation plans and ideas. | ||
Comments:
| ||
Other factors (use of professional tools, security considerations, impact on society etc.) | The team has effectively used appropriate professional
tools and systems. It has carefully analyzed its design and implementation
to identify potential security holes and documented them. The team has
considered the implications of
various aspects of the ACM/IEEE Code as it applies to this system and
appropriately discussed the relevant questions with the project sponsor.
Strongly Agree Agree Disagree Strongly Disagree Not Applicable | |
Comments:
| ||
Effectiveness as a Project Team |
The students in this team seem to have worked together very effectively
on all aspects of the project from initial formulation based on the
sponsor's goals/ requirements, through exploring design alternatives, working
on the implementation details, the documentation of the project, through the
preparation of the poster. The students also worked effectively as a team
in responding to questions and comments from visitors to the poster session.
Strongly Agree Agree Disagree Strongly Disagree Not Applicable | |
Comments:
| ||
Communication Effectiveness | The team has produced a well-designed poster
that pays careful attention to the items included and the level of
detail presented. The poster effectively
integrates elements related to basic background of the project
with key technical factors. Responses to questions perfectly complemented the
poster with the team providing the right level of detail.
Strongly Agree Agree Disagree Strongly Disagree Not Applicable | |
Comments:
|
Maybe the following should be omitted?:
Evaluator's name: __________________________________________
Date of evaluation: __________________________________________