iiinova — where your digital self keeps evolving

Kirstin Moreno, PhD

@aguasfrescas.bsky.social

388 followers 1.9K following 36 posts

Research + Evaluation Scientist in energy efficiency. Former Asst Prof + higher ed admin in academic health. Alt-Ac (ed linguistics). Gringa. She/her

Posts Replies Media

Kirstin Moreno, PhD @aguasfrescas.bsky.social · 20/12/2025

My co-authors and I have wrapped up a 4 year effort to create, iterate, and publish a learning outcomes framework which all of OHSU's academic programs now align to in institutional assessment processes. #assessment #outcomes #highered #learning #delphi #scopingreview #academicmedicine

Visual abstract in yellow which shows two studies related to a new assessment framework the authors created. Left side is study 1, right is study 2, the bottom center is the image of the framework itself.

Study 1 was a scoing review of learning outcomes frameworks. Research objectives: 1.) What frameworks are used for assessment? 2.) What are their purposes and categories? 3.) Which elements make space for diverse ways of knowing, cetnering learners, social justice, and equity? Methods include reviewing 1,689 articles and including 43 articles in the actual study. See the link to the paper for summaries and a crosswalk of 22 assessment frameworks including from the gloal south, and a categorization of frameworks by equity centered vs. equity minded approaches.

Study 2 on the right was a delphi study which used assessment expert feedback to refine our learning outcomes framework, examples, and framing questions. Methods included 39 assessment experts who provided extensive feedback on our framework over 3 iterative rounds until they reached consensus. See study 2 for a transparent description of how we conducted the delphi study and decisions made in iteration, the framing questions for understanding each level, and examples of learning assessment at each level across different disciplines.

The graphic at the bottom has arrows from both studies pointing toward it. It is shades of purpole and yellow, embedded boxes, with a magnifying glass off to the left side. The Evidence of Learning and Impact Framework is the title, and the five levels are Knowledge, Application, Performance, Impact of Learning on Self, and Impact of Learning on Others. They are only somewhat hierarchical, with the Impact levels off to the side as to not imply hierarchy. The magnifying glass says Equity Lenses and lists Participation, Satisfaction, and Achievement, with the note that they are used to examine each level. Citations are also included as well as journal logos.

120

Kirstin Moreno, PhD @aguasfrescas.bsky.social · 20/12/2025

I work in energy efficiency now, but am wrapping up research projects from my time at OHSU in academic medicine. One of those projects was published last month in the Journal of Surgery Education. (My first attempt at a visual abstract!) #surgeryeducation #clinicalteaching #feedback

100

Kirstin Moreno, PhD @aguasfrescas.bsky.social · 16/11/2024

I historically rarely post on social media because I am here to listen to expertise and learn. I've pivoted in my career too much to be a deep expert myself; I'm a generalist. I've broadly worked across many parts of Education (K-12 teaching and professional development, community college advising,

120