Skip navigation
All Places > Institutional Solutions > Blog
1 2 Previous Next

Institutional Solutions

30 posts

Roompact and Skyfactor Benchworks are pleased to announce a strategic collaboration to explore how combining Benchworks' nationally-validated assessment, analytics and benchmarking with Roompact’s expertise in residential education and curricular software can help campuses gain deeper insights on their operations and students to empower continuous improvement.

 

Formerly known as EBI, Benchworks is a Macmillan Learning company that provides more than thirty student affairs assessments mapped to accreditation and professional standards: including Resident and Student Staff surveys that provide insights for departments of housing and residence life to improve their overall practice. Benchworks also offers a New Student Survey that helps identify student retention risk factors and provides opportunities for staff support and intervention.

 

Roompact, a residence life and education software and services company, provides departments of departments of housing and residence life with a variety of tools to aid staff members in improving their efficiency, and in tracking and assessing programs, services, and interventions with students throughout the academic year.  In addition to helping with operations, Roompact has a special emphasis and unique tools to aid in student learning, assessment, and residential curriculum development.

 

In the coming weeks researchers from Roompact and Benchworks will be conducting interviews and focus groups to gather feedback on the types of collaboration that may most benefit residence life professionals.

 

For more information visit: http://www.skyfactor.com/

Several classic works on college student development emphasize the importance of interactions to student development, learning, and success. To that end, many institutions put significant effort and resources towards efforts to help students build positive peers connections. Intuitively, higher education professionals understand the importance of positive peer connections. However, it is crucial to highlight data and research to back up these stories and theories. This note explores peer connections in first-year college students using responses from a national survey of over 25,000 first-year college students from nearly 30 institutions in the United States.

 

Key Questions:

  1. To what degree did first-year students report making connections with peers?
  2. Were there differences in peer connections across different populations?
  3. How did peer connections relate to the first-year student experience?

 

The concept of homesickness in college students has likely been around for as long as students have been leaving home to go to college. However, there are no universally accepted definitions. Few measures of homesickness in college students exist. Little research has been conducted connecting homesickness directly to the experiences of college students and their academic success, and those that have been done are typically limited to a single campus. This note explores the concept of homesickness in college students using response from a national survey of over 25,000 first-year college students from nearly 30 institutions in the United States.

 

Key Questions:

  1. What is homesickness?
  2. How prevalent is homesickness in first-year students?
  3. How is homesickness related to the first-year student experience?

 

The Bureau of Labor Statistics predicts that between 2016 and 2026, overall employment of advanced nurse practitioners will increase by about 31%1 . The aging population in the United States as well as an emphasis on preventative care have created greater demand for nurse practitioners with advanced degrees.

 

Given the crucial nature of the work these professionals do, it is important to understand how a Master of Science in Nursing (MSN) program contributes to the high-level mastery of skills essential in the medical field. This research note details findings from a national dataset constructed from the AACN/Benchworks MSN Exit Assessment of over 8,000 MSN students from nearly 150 colleges and universities in the United States. In particular, this research notes explores the relationship between overall learning, student characteristics, and various components of the MSN student experience.

 

Key Questions:

  1. Who are our MSN program graduates?
  2. How do graduating MSN students rate their overall experience?
  3. Which learning factors relate to overall learning in MSN programs?
  4. Which satisfaction factors relate to overall learning in MSN programs?

 

Recreation centers play a vital role in the university experience. These services offer students opportunities to participate in both structured and unstructured activities such as fitness classes, intramural sports teams, and outdoor adventures like hiking and camping. Recreational facilities and events encourage students to develop health and wellness practices and are associated with a number of positive health and learning outcomes.

This research note explores students’ satisfaction with campus recreation services and the learning outcomes associated with them. The findings, summarized as five key insights, are drawn from a national dataset constructed from the responses of over 2,500 college students to the Benchworks Recreation Services Assessment during the 2017-2018 academic year.

Higher education researchers have long understood the role campus involvement plays in supporting student success. Extracurricular participation supplements the classroom experience by allowing students to grow and learn as part of their broader college experience. As such, ensuring our students engage in these experiences—and get the most out of them—is crucial. This research note explores the relationship between student activities participation and other educational outcomes. The findings, presented as five key insights, were drawn from a national dataset constructed from the responses of over 5,000 college students to the ACUI/Benchworks Student Activities Assessment.

A major consideration for any assessment project is the timing of it. In fact, questions related to timing are some of the most common questions that Skyfactor’s Analytics & Research Team gets from clients. And, it’s a good question to ask. Considering the timing of your assessment is a crucial component of a good assessment project. Previously, our Director of Analytics & Research, Sherry Woosley, wrote about the timing of assessments, in particular whether or not there are advantages to surveying in fall versus spring.

 

While the particular timing of your assessment is important, so is the frequency. Another common questions we get from clients relates to how often to assess, in particular, if a benchmarking assessment should be administered every year. This question is especially common for campuses that have conducted benchmarking assessments for multiple consecutive years and say that, at a high level, the results simply don’t change that much.

 

There are certainly valid reasons for considering a shift to conducting a particular benchmarking assessment every other year or as part of a cycle. Cost, in particular, is one benefit. There is an assumption that, since the high-level results don’t change much from year to year, that an every-other-year approach will save money and provide a sufficient snapshot of any changes over time. And, campuses may save money or be able to triangulate data better by pulling in other assessments in the “off-years.”

 

But, there are real benefits to conducting a benchmarking survey each and every year that must be taken into consideration.

 

Justifying Needs

Annual benchmarking data allows a department to make a more compelling case for justifying particular needs. By breaking down results across campus, departments are more easily able to identify exactly where improvements should be made. For example, for a housing department looking to make a difference on facilities satisfaction, identifying specific buildings that need improvement (even something as simple as new paint in common areas) can go a long way.

Identifying issues not only at a granular level but also as they come up allow for campuses to justify changes, especially minor changes that can have an immediate impact. One of the common reason campuses administer a survey in fall versus spring is to allow time to react and implement changes during the current academic year that reflect the pressing needs of your current students. Surveying each year allows your campus to take quick action and make a difference.

 

Motivating Staff

One of the value points of benchmarking data is the ability to use data to motivate and excite staff. Many campuses use the ability to share reports to current staff as a mechanism to review performance and identify areas of improvement. And, since reports can be filtered to a population or area that is directly applicable to individual staff members, it makes the data more personal. Sharing filtered reports with residence hall directors, assistant directors of student activities, orientation leaders, and more, you can use annual results to motivate your staff and focus their efforts on areas that can make a difference.

 

Studying Smaller Populations

Annual surveys allow for opportunities to better focus on smaller populations. At the aggregate level, campus-level results may look really good! However, many benefit from using the survey to target specific populations to improve experiences more intimately. If you are using the survey on a yearly basis, you are better able to address issues that disproportionately affect smaller populations, as well as focusing on improvements to different, smaller populations each year.

 

Demonstrating Improvement

Annual benchmarking data allow your campus to demonstrate the impact of your efforts each and every year. Our efforts to improve the student experience never stop. So, collecting data each year allows for better demonstration of the impact of particular efforts. The before and after snapshot of a new programming effort, targeted staff outreach, new learning outcomes, or facilities improvements are incredibly valuable to demonstrating that your efforts make a difference. If left to data collected only every few years, it’s more difficult to identify which efforts had an impact on the learning and satisfaction of your students.

 

Ultimately, collecting data annually allows for campuses to better tell a compelling data story highlighting their hard work. While those who work closely with student affairs departments understand the incredible impact of their efforts, compelling data points are necessary to justify resources, education external stakeholders, and justify efforts, in particular in a time where campuses are being asked to do more with less resources. Annual data collection empowers departments to tell a more impactful story of the hard work they do each and every year.


Whether to demonstrate the impact of efforts, justify resources, better identify needs, or continually motivate staff, there are significant benefits to collecting reliable and valid benchmarking data each year.

Whether inside the classroom, in residence halls, or in student activities, opportunities for students to make meaningful connections are plentiful. These connections lead to a sense of community and belonging, which in turn support student success. Data from a variety of Skyfactor assessments demonstrate the prevalence and importance of positive connections across campus.

The positive impacts of student employees to our campus offices and departments are clear. They perform essential duties that allow the institution to function on a day-to-day basis. But, these employment opportunities also help our students to build valuable professional skills to support their post-graduation plans while providing them with a source of income while in school. Student employment programs are obligated to provide a safe and productive work environment to student employees in order to maximize their learning potential as well as their contributions to the institution.

 

This research note details findings from a national dataset constructed from the 2017-2018 Benchworks Student Employee Survey of over 1,000 student employees from 12 colleges and universities in the United States. In particular, this research notes details demographics of student employees, explores overall perceptions of the experience, and details concepts that have the strongest statistical relationships with overall perceptions of the experience.

 

Key Questions:

  1. Who are our student employees?
  2. How do student employees rate their overall experience?
  3. Which satisfaction factors have the strongest relationship with overall program effectiveness?
  4. Which learning factors have the strongest relationship with overall program effectiveness

Benchmarking is one of many powerful tools that can be used by higher education professionals to make sense of survey results. Benchmarking is the practice of making comparisons in order to drive continuous improvement. To some, using a benchmarking survey is a challenging and complicated endeavor. However, benchmarking doesn’t have to be scary. Read on for more information about benchmarking surveys, why they are valuable, and tips for working them into your assessment toolbox!

 

UPCOMING WEBINARS

January 23rd @ 2:00 PM ET

Enhance the level of learning in your classroom by asking higher level questions for problem solving, making connections, and peer interaction. This webinar, led by Cindy Albert of the University of Wisconsin--Eau Claire, will provide tips for creating question prompts, as well as how to craft the follow up questions to encourage deeper learning.

REGISTER

 

PAST WEBINARS

Intuitively, we know a lot has changed in higher education over the past ten years, both with our students and our practices, in particular with campus housing. And, we can think of many stories that reflect these changes. But, which of these stories show up in our data, and what in the data surprise us? Using data from the last ten years of the ACUHO-I/Benchworks Resident Assessment, we’ll explore ten key trends from the last ten years in housing.

WATCH RECORDING

 

In the search for and creation of open educational resources (OER), faculty must be aware of copyright and open license protections and uses of materials under the law. All types of works have a license outlining terms or conditions of use. This webinar will review all forms of licensing of published and unpublished works designated all rights reserved, in the public domain, or with a Creative Commons license. We will discuss the rules for distributing, performing, displaying, copying, and/or making derivatives of a work based on its license.

WATCH RECORDING

One of the biggest challenges with assessment data is making sense of it and acting on it. How do we know when results are outstanding or concerning? What if the results are below average? What should our target performance be? Benchmarking can help provide answers to these questions and more! In this webinar, we'll explore what benchmarking is, why campuses would use benchmarking, and different types of benchmarking.

WATCH RECORDING

Clickers can dramatically improve your students’ engagement in the classroom. But, like all teaching tools, there are more and less effective ways of incorporating them into your class. This webinar will include a brief review of the motivations for using clickers, as well as practical guidelines for ensuring their success, including writing effective questions, facilitating student discussion and choosing a grading policy that minimizes stress for you and your students. Enrollment will be limited to ensure all participants have time to ask questions and share experiences.

WATCH RECORDING

Data from benchmarking assessments has the potential provide valuable insights into the college student experience, put results into context, and motivate staff to drive program improvements. However, applying benchmarking data in practice to things like strategic planning, accreditation, and resource allocation can be challenging. What are some practical strategies for making the most of our benchmarking data? In this webinar, professionals from several four-year institutions will highlight examples of how they have used benchmarking data from ACUI/Skyfactor assessments—including student union, activities, and student employees—to improve both their work and the experiences of their students.

WATCH RECORDING

Student engagement and affordability are hot topics on most campuses of higher education. In this webinar, Leif Nelson, Director of Learning Technology Solutions at Boise State University, will discuss these important topics, and will share specific examples and initiatives of how Boise State is addressing these challenges to help their students succeed.

WATCH RECORDING

Using a student engagement tool integrated into your campus learning management system can help engage students and help you measure student performance. Join Dr. Leslie Hendrix, Clinical Assistant Professor at the University of South Carolina and active learning guru, as she shares her best practices from using both the iClicker student engagement tool and Canvas learning management system in her own classroom.

WATCH RECORDING

Nursing programs purpose themselves to be accountable to communities of interest—to include the nursing profession, consumers, employers, peer institutions of higher education, students and their families. CCNE accreditation validates the success a nursing program achieved related to mission, goals and outcomes. As nursing faculty and administrators, we have to be able to nimbly understand and communicate our program outcomes based on data we collected and analyzed—we need agility to draw conclusions as to what our communities of interest value and what makes our program unique and effective in fulfilling our mission. Join this webinar to learn how to use internal and external data sources to provide evidence of programmatic assessment plan effectiveness. The speaker will address ways to effectively “tell your success stories” to CCNE site visitors and communities of interest through use of multiple data sources. The audience will be given examples of how relevant data sharing, sculpted to fit specific communities of interest, can optimize and leverage program outcomes.

WATCH RECORDING

Join us to discover how iClicker is built on the science of active learning. Marcy Baughman, Director of Impact Research at Macmillan Learning, will discuss how her team is using learning research, learning design, data-driven insights and Impact Research to develop and refine the iClicker classroom engagement tool -- and how usage of iClicker can lead to higher student in-class engagement and better course outcomes.

WATCH RECORDING

This webinar, hosted by Kathy Roberts of the University of North Texas, presents how they implemented a new student response system--in this case, iClicker Cloud. Ideal for instructional technologists and those working in the departments of teaching and learning, Kathy will present steps (and mis-steps) they experienced along the way to an a successful implementation. This webinar is also well-suited for faculty and deparment heads interested in standardizing on a single student response system.

WATCH RECORDING

A vital component of CAEP accreditation is the need for reliable and valid data to demonstrate continuous program improvement. Part of the requirements, specifically those in standard four of the CAEP accreditation standards, call on teacher education programs to demonstrate not only satisfaction of program completers and employers, but also the preparedness of completers to positively impact student learning. In this webinar, one campus that recently earned CAEP accreditation will highlight how they use a variety of data sources—including national benchmarking assessments of graduating seniors, alumni, and employers—to support CAEP accreditation efforts, benchmark against peer institutions, and drive continuous improvements to their teacher education program.

WATCH RECORDING

Student Response systems are traditionally thought of as in-class tools. And why not? They are great for creating connections, improving student focus, identifying misconceptions, and giving every student a voice. But there are a variety of ways that schools are beginning to use Student Response systems. Dr. Kimi King of the University of North Texas will present some ways that she uses iClicker Cloud (the Student Response System at UNT) in creative, out of the box ways. This presentation is ideal for faculty or administrators interested in adopting a SRS for the institution, and how to maximize that investment.

WATCH RECORDING

One of the biggest challenges with assessment data is making sense of it and acting on it. How do we know when results are outstanding or concerning? What if the results are below average? What should our target performance be? Benchmarking can help provide answers to these questions and more! In this webinar, we'll explore what benchmarking is, why campuses would use benchmarking, and different types of benchmarking. Participants will learn about practical strategies for making the most of benchmarking data for any campus.

WATCH RECORDING
Sara Jo Lee

Nursing Education

Posted by Sara Jo Lee Nov 30, 2018

For almost two decades, in effort to evaluate (and therefore strengthen programming) as well as support accreditation, Skyfactor Benchworks in partnership with the American Association of Colleges of Nursing (AACN) created assessments to measure the effectiveness of certain program elements from the student perspective.1

 

The findings from this assessment allowed for an exploration of how nursing programs influence and contribute to learning outcomes related to professional values, core competencies, technical skills, core knowledge, and role development.

 

Professional Values

In response to demonstrating accountability in areas such as advocacy for vulnerable patients, fairness in the delivery of care, honoring the rights of patients, and delivering culturally competent care, at least 75% of the students reported this as being taught at “moderate” or “large” extent.2

 

Core Competencies

At least 67% of students indicated the nursing program taught them to apply research-based knowledge as a basis for practice, to assist patients in understanding/interpreting the meaning of health information as well as correctly evaluating a patient’s ability to assume the responsibility of self-care. 60% of students reported that the program taught them to make effective presentations.

 

Technical Skills

80% of students indicated they gained technical skills related to assessing vital signs and applying infection control measures from the nursing program. Approximately 75% reported being taught skills related to providing pain reduction measures and medication administration by all routes. Related to those, 60% and approximately 67% of students indicated being taught to manage wounds and provide emotional support in preparation for therapeutic procedures, respectively.

 

Respondents were divided into groups by previous healthcare experience before entering the nursing program: less than one year, 1-4 years, more than 4 years. When analyzing responses, the differences in professional value and core competencies were statistically significant but small. The biggest difference was in technical skills with respondents entering the nursing program with less than four years of healthcare experience being more likely than other respondents to indicate that the nursing program taught them technical skills such as assessing vital signs and applying infection control measures. There are also significant and important differences among degree programs as it relates to learning outcomes. In a comparison of BSN, RN, and Accelerated programs, respondents from the Accelerated program were far less likely to indicate being taught learning outcomes related to professional values, core competencies, and technical skills than respondents completing BSN and RN relationships. To drill down further, while the percentages of BSN and RN completion respondents indicated their program had taught them learning outcomes related to professional values and core competencies, RN completion respondents were significantly less likely than BSN respondents to report their program had taught them to assess vital signs, apply infection control measures, provide pain medication measures, and administer medications by all routes.

 

Core Knowledge

At least 65% of students reported that the nursing program taught them to apply an ethical, decision-making framework to clinical situations and to assess predictive factors that influence the health of patients; and 60% reported being taught to use appropriate technologies to assess patients, communicate with healthcare professionals to deliver high-quality patient care, and understand the effects of health policies on diverse populations (with an understanding of the global healthcare environment).

 

Role Development

The majority of respondents reported that they were taught the idea of lifelong learning in support of excellence in nursing practice. More than 60% indicated they were taught to incorporate nursing standards into practice, integrate theory to develop a foundation for practice, and delegate nursing care while retaining accountability.

 

As was the case of technical skills, previous healthcare experience impacted the degree to which students indicated the nursing program taught key core knowledge and role development learning outcomes. Students with four or more years of previous healthcare experience were more likely to report on being largely taught learning outcomes outside of technical skills to a large degree such as: understanding the effects of healthcare policies on diverse populations (73%), assisting patients to achieve a peaceful end of life (71%), understanding how healthcare delivery systems are organized and the global healthcare environment, and incorporate knowledge of cost factors when delivering care. Along with reporting a higher value on life-long learning, respondents indicated being taught to integrate theories and concepts from liberal education into nursing practice and delegating nursing care while retaining accountability.

 

There were also notable differences between degree programs as it related to learning outcomes with significantly fewer respondents from Accelerated nursing programs indicating that they were taught learning outcomes related to core knowledge than BSN and RN completion respondents.

 

Overall, the majority of student respondents indicated the nursing program (regardless of program or previous healthcare experience) had taught them to achieve a variety of key learning outcomes related to professional values, core competencies, and technical skills.

 

___________________________________________________________________________________

1. Skyfactor Benchmarks, in partnership with the American Association of Colleges of Nursing (AACN), created the Nursing Education Assessments to measure the effectiveness of programs from the student’s perspective. During the 2013-2014 academic year, 24,793 students participated in the undergraduate assessment.

2. All percentages reported here indicate responses of “moderate” and “large” extent.

Macmillan Learning remains committed to helping all users enjoy equal access to our digital learning solutions. We put accessibility, information security and user privacy at the forefront of our product development and marketing practices. Check out our VP of Information Security & Privacy, Stephen Davis, discussing our commitment to accessibility, security and respect of our users' privacy.

 

Owing to the immense responsibilities entrusted to teachers, teacher education programs are tasked with setting a curriculum that prepares students for the challenges and rigors of professional teaching. Administrators must identify which components of the program are most effective, which are not as effective, and refocus their efforts accordingly. Data from the 2017-2018 Benchworks Teacher Education Exit survey provides program administrators with valuable insight into students’ overall learning and the aspects of the program that contribute to it.

 

This research note details findings from the Benchworks Teacher Education Exit Assessment of over 2,500 graduating teacher education students from 21 colleges and universities in the United States. In particular, this research notes explores concepts—both learning and satisfaction—that relate to overall learning as a result of the teacher education program experience.

 

Key Questions:

  1. Who are our teacher education program graduates?
  2. How do graduating teacher education students rate their overall experience?
  3. Which learning factors relate to overall learning in teacher education programs?
  4. Which satisfaction factors relate to overall learning in teacher education programs?

In a previous blog post, I wrote about the importance of building student communities to student success. Long story short, valuable connections are happening across campuses each and every day. And, we need valid data points to pair with the powerful stories we have on the prevalence and impact of these connections.

 

Given the importance of campus connections to sense of belonging and broader student success, it is of value to explore the physical spaces where these connections often occur. One area on campus that is primed to be a central point of building and strengthening community is the student union. Student unions and student centers, by their very nature, are intended to be a hub of student life, activity, and connections on campus. And, these environments are increasingly designed and intended to support student learning.

 

Designed in partnership with ACUI, the ACUI/Benchworks College Union Assessment provides campuses with valuable data on the college union experience. The assessment contains a wide range of questions, ranging from when and how these use the facility to satisfaction with different services. It also measures key learning outcomes that we would expect our students to gain as a result of their interactions and experience in these facilities. And, with over a decade of data from over 250 colleges and universities in the United States, we’ve learned a lot about the college union experience.  

 

So, what have we learned? Here are three, high-level things we consistently seen in the national data:

 

Students visit unions frequently

 

If a facility is meant to be the hub of student life, it should be a facility that students frequent often. And, data from our assessment shows that this is indeed the case. For the 2017-2018 academic year, nearly 90% of survey respondents indicating visiting their college union at least one during the academic year. Of those who visited at least one, four out of five visited their union at least once per week, while nearly 25% reported visiting at least one a day or more. And, while those visits are spread throughout the day, the period of time with the highest traffic is between 9am and 2pm, when two-thirds of respondents indicated they typically visit their college union.

 

Students visit for a variety of reasons

 

From providing options for dining to spaces for student activities, and offices for key services, college unions are remarkably diverse in their services and offerings. And, the national data on why students visit their college union or student center reflect the wide-ranging purposes of the facilities themselves. When asked to identify the top three reasons out of over fifteen for visiting their college union, almost everyone--98%--indicated that food-related offerings were a top reason for visiting. Other top reasons for visiting their college union included:

 

  • Studying (91%)
  • Meeting others (88%)
  • Attending programs or events (78%)
  • Visiting the bookstore (77%)
  • Relaxing (71%)
  • Attending student organization meetings (68%)

 

So, the national data reflect that, while students are visiting their college union for more transactional needs, like buying textbooks or getting lunch, they are also utilizing the facility for connecting, as many of the top reasons for visiting include meeting other students, attending programs, or attending organization meetings.

 

Unions successfully help to build a sense of community

 

For a college union to be successfully fulfilling its mission of serving as a hub of student life and helping to build a sense of community, we would expect more than usage data showing numerous visits for a variety of reasons. We would also expect student perceptions of those unions--centered around both satisfaction and learning--to highlight the role that unions play in supporting student success. Nationally, the data from the ACUI/Benchworks College Union Assessment reflects just that.

 

Across a variety of outcomes, union visitors indicated that their experience with unions, their activities, and their services all reflect a facility that is truly the hub of student life and connections. For instance, nearly three out of four union visitors were both satisfied with the extent to which their college union promotes a sense of community on campus and agreed that their union is a place to get involved in campus life.

 

Furthermore, student perceptions also reflect the role of unions and union activities in contributing to learning. For instance, 40% of union visitors indicated that their college union experience enhanced their ability to interact socially. And, 26% of visitors indicated that their college union activities expand their understanding of their role as a citizen of the college community.

 

To top it off, unions do this while being conscious of student activity fee dollars. When considering the fees paid to support their union with the quality of activities and services provided, 88% of union visitors rated the value of how their dollars were spent as at least “Fair.” 37% of visitors rated the value of their dollars as very good or higher.

 

So, at a high level, unions help to bring students together; provide opportunities for learning that, among other things, build campus connections; and provide all of this and more at a valuable rate for students.

 

Want more? We’ve got you covered

There’s much more to the college union experience than three high-level findings. How do the visit rates differ across key populations? What concepts most closely predict high union effectiveness? How does frequency of visits relate to reasons for visiting or satisfaction with the facility? For these points and more, check out two of our recent research notes, one of which goes deeper into what we’ve learned about the college union experience and the other explores frequency of visits and how it relates to union perceptions and usage.   

 

 

And, if you have other questions that we haven’t addressed yet in these notes, ask us and we’ll add it to our list!