Research

Research Aims
My program of research addresses three interrelated goals:

1. helping education leaders implement and measure
global citizenship education (GCE) programs

2. comparing GCE programs’ possibilities and constraints internationally and cross-culturally

3. discovering opportunities and conditions that enable students, especially attendees of rural and/or remote schools, to avail themselves of GCE programs
Awards & Honors
2017Gary E. Smith Summer Professional Development Award for highly original research contribution
2015: Sasakawa Young Leaders Fellowship for international research (see p. 3)
2015: American Enterprise Institute Education Policy Academy
2014: Margaret McBride Lehrman Fellowship for written communication
2014: Best poster (Education and Development), University of Oregon Graduate Student Research Forum
2013: Paul and Kate Farmer award for excellence in writing, English Journal  
Manuscripts in Development (n = 16)

  1.  Chadwick, K. L., Thier, M., Todd, J., & Fukuda, E. Benefits and challenges in using the Success Case Method in evaluation.
  2. Martinez, C. R., Jr., Thier, M., Flores, M., Beach, P. T., Pitts, C., & Witherspoon, L. Conceptualizing an equity-sustaining framework.
  3. Perry, L. B., Thier, M., Beach, P., Anderson, R., Roberts, P., & Thoennessen, N-M. Opportunities and conditions to learn (OCL): A conceptual framework.
  4. Roberts, P., & Thier, M. Disaggregating remoteness as a school-level predictor of NAPLAN achievement.
  5. Thier, M. It’s where you’re poor, not if you’re poor: Opportunities for International Baccalaureate education.
  6. Thier, M., Al-Resheed, F., Lybarger, P., Sasaki, A., Meline, M., …, & Martinez, C. R., Jr. Cultural adaptation of best, evidence-based, and promising practices: A systematic literature review.
  7. Thier, M., Kim, M. H., & D’Aquilanto, K. It matters how you ask: Assessing the knowledge, skills, behaviors, or dispositions of global citizenship.
  8. Thier, M., Beach, P., Todd, J., & Coleman, M. Places, poverty, and pupils: Exploring key predictors of Advanced Placement access.
  9. Thier, M., Chadwick, K. L., Fukuda, E., & Manlove, S. Improving document analysis techniques through reverse or bidirectional crosswalks.
  10. Thier, M., & Mason, D. Nominal group technique as a pretest/posttest measure of a dispositional construct.
  11. Thier, M., Porter, L., Beach, P., & Hollenbeck, K. Country grammar: How understanding rural nuance can immunize districts from one-size-fits-all decisions.
  12. Thier, M., Porter, L., Gomez, D., & McWhirter, E. Standardizing non-global citizens: Untangling requirements for high school graduation and university admissions.
  13. Thier, M., & Smith, J. Globally organized: School system types that can democratize access to global citizenship education.
  14. Thier, M., Todd, J., Men, V., Curry M., & Yoon, H. Of peripheral concern: Center-periphery differences and opportunity to learn rigorous curricula.
  15. Thier, M., & Wellesley, L. C. A multinational, mixed-methods inquiry of high school students’ global citizenship.
  16. Todd, J., Thier, M., Yoon, H., & Perry, L. B. Radiating inequalities: Parsing geographical definitions and proxies to detect international differences in opportunity-to-learn rigorous coursework.
Published Journal Articles (n = 10)
Manuscripts under Peer Review (n = 4)

[10] Thier, M. (In press). Curbing ignorance and apathy (across the political spectrum) through global citizenship education. Berkeley Review of Education.
After a historically inexplicable presidential election, Americans must grapple with the causes, not just the effects, of a Trump presidency. Responding to a campaign that bombarded the electorate with nonsensical rhetoric and a seemingly endless array of –isms, this essay argues for expansive global citizenship education (GCE) in K-12 schools. GCE can provide the knowledge, skills, behaviors, and dispositions to live, learn, and work amid the opportunities and challenges that globalization bring. The essay explores benefits of, and risks of not, endorsing this progressive approach to education that can pay dividends for students, communities, and a democratic nation.

[9] Anderson, R., Thier, M., & Pitts, C. (2017). Alternative assessments for interpersonal and intrapersonal skills: Self-reports, situational-judgment tests, and discrete-choice experiments. Learning and Individual Differences, 53(3), 47-60.
Heeding a groundswell of researcher and practitioner interest in students' interpersonal and intrapersonal skills, we evaluated three measurement approaches for creativity and global citizenship. We designed a 10-criteria evaluative framework from seminal and cutting-edge research to compare extant self-reports and situational-judgment tests (SJTs) from each construct and to design two discrete-choice experiments (DCEs). We detailed opportunities, challenges, and tradeoffs for each approach's design considerations, possibilities for bias, and validity-related issues. Researchers rely heavily upon self-reports to measure constructs, such as creative thinking and global citizenship. We found evidence that the self-reports evaluated were susceptible to some biases more than others. We found SJTs and DCEs to mitigate some concerns of bias and validity present in self-report, and make recommendations to develop these formats.

[8] Mason, D., & Thier, M. (2017). Study abroad, global citizenship, and the study of international nongovernmental organizations. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, 1-25.
Nonprofit education and management programs often recognize the efficacy of including experiential learning opportunities such as study abroad in their curricula. In addition, higher education institutions increasingly prioritize global citizenship as a learning outcome. However, challenges abound for educators who want to evaluate study-abroad courses that expect students to acquire or deepen their levels of global citizenship. This study seeks to evaluate the impact of a short-course study abroad program on students’ global citizenship orientation. Findings: students grapple with global citizenship in various ways while immersed in such a course and can express conflicting views, further confounding understanding of how to best measure global citizenship. We discuss implications for students expressing more of an observational role than an inclination to act on global issues.

[7] Martinez, Jr., C. R., Schwartz, S., Thier, M., & McClure, H. H. (2017). A tale of two measures: Concordance between the ARSMA-II and the BIQ acculturation scales among Latino immigrant families. Psychological Assessment
Different measures of acculturation (i.e., how immigrants acquire customs/characteristics of a new receiving society while retaining their heritage's custom/characteristics) are often assumed to be interchangeable, although this assumption is rarely tested empirically. We examine overlap between commonly used measures of acculturation among individuals of Latino/Hispanic ancestry in the United States: the Acculturation Rating Scale for Mexican Americans II (ARSMA-II) and the Bicultural Involvement Questionnaire-Short Version (BIQ-S). Specifically, we examined how scores from the measures relate, as well as similarities versus differences in how they predict family functioning, parenting, and youth adjustment. Given the largely nonoverlapping set of relations of the measures' subscale scores with language dominance and conflict, parenting, and youth outcomes, we recommend that studies utilize both of these measures to fully appraise acculturation in this population.

[6] Smith, J., Thier, M., & McClure, H. H. (2017). Stakeholder-informed research design: Lessons about culture and context from Qatar. SAGE Research Methods Cases
International research presents unique possibilities for peril. Without understanding local context, culture, and norms, data-collection efforts may produce little usable data. This case study reports lessons learned about the importance of involving broad stakeholder groups in the design phase of a study. To inform the design of a 3-year study to examine the experiences of Qatari and Qatar-born female students in Education City, an international hub for higher education in Doha, Qatar, our research team spent 10 days in Education City meeting with staff and faculty individually and through focus groups. It became apparent that cultural and other contextual considerations would render our intended design—longitudinal data collection with student surveys alongside qualitative methods—suboptimal for collecting data from the population of interest. Thus, during a graffiti-style focus group, we solicited feedback on four additional proposed data sources and collection methods: student digital photo journals, alumnae interviews, parent focus groups, and staff/faculty surveys. Our processes enabled our refinement of study design for cultural appropriateness and increased likelihood of generating valid, authentic data. Our lessons highlight the need to consider participants’ norms and values in research design. 

[5] Smith, J., & Thier, M. (2017). Challenges to Common Core State Standards implementation: Views from six states. NASSP Bulletin: Official Journal of the National Association of Secondary School Principals.
Common Core State Standards (CCSS) implementation has challenged many school leaders. We apply a policy implementation framework to data from 46 interviews in six states. We find multiple barriers to CCSS implementation that suggest states' needs to increase local capacity, build will to implement, and engage in information campaigns to promote CCSS beyond educator audiences, thus to the greater public. 

[4] Shanley, L., Strand Cary, M., Clarke, B., Guerriero, M. A., & Thier, M. (2017). Instructors’ technology experience and iPad delivered intervention implementation: A mixed methods replication studyEducational Technology Research and Development, 65(4), 815-830.
Instructor facilitation is essential for successful implementation of technology-based interventions in school settings. We report results from two studies from the development of KinderTEK, an iPad delivered kindergarten mathematics intervention, to determine the relation between instructor-reported technology experience and intervention implementation, as measured by student use. Participating instructors had a range of pre-intervention technological experience with iPads, a range that corresponded with student use in both within class variability of student use and percentage of students meeting duration of use targets. Findings also confirm prior research: second-order technology barriers may be most influential on intervention implementation; however, quantity of barriers reported (regardless of type) also associates with percentage of students who meet duration of use targets. Instructors who reported moderate experience with iPads and/or no barriers to technology integration demonstrate the least desirable student use patterns. 

[3] Thier, M., Smith, J., Pitts, C., & Anderson, R. (2016). Influential spheres: Examining actors’ perceptions of education governance. International Journal of Education Policy and Leadership, 11(9).
Many layers of education governance press upon U.S. schools, so we separated state actors into those internal to and those external to the system. To unpack the traditional state–local dichotomy, we used interview data (n = 45) from six case-study states. We analyzed local leaders’, state-internal actors’, and state-external players’ perceptions of implementation flexibility and hindrances across several policy areas. We observed how interviewees’ spheres of influence link to which policy areas they view as salient or not, and their relative emphases on who and what within state education systems contributed to implementation flexibility and/or hindrances, and how these factors play out. The local sphere was the most coherent, and state-internal was least so. We discuss implications for education governance research, applications for practitioners and policymakers, and a methodological contribution. 

[2] Thier, M., Thomas, R., Tanaka, J., & Minami, L. A. (2016). Global by design: A participatory evaluation of a global citizenship after-school program. Journal of Research in Curriculum and Instruction, 20(3), 220-231. 
OneWorld Now! (OWN) is an after-school program that focuses on global citizenship education by serving Seattle high school students with Arabic or Mandarin instruction, leadership coursework, and study abroad. A participatory program evaluation showed (a) OWN’s leadership curriculum to align with most standards for promising and evidence-based practices, (b) a year of OWN’s leadership coursework to associate with elevated levels of global citizenship, and (c) mixed results when comparing OWN’s recruitment methods to a high school-specific definition for global citizenship development. We discuss OWN’s status as a rare program to prioritize global citizenship and serve mostly economically disadvantaged students, plus opportunities for OWN to improve its design and theory. 

A high school teacher describes an assignment that draws on Hall’s cultural iceberg to help students develop global perspectives and hone close-reading/analytical skills. This article received the Paul and Kate Farmer award for excellence in writing.

Manuscripts under Peer Review
[4] Thier, M., & Ledger, S. Standards and poor: Evidence of global citizenship orientation in Australian and U.S. education standards.
Both Australia and the United States’ K-12 systems share emphases on governance through standards. Within those national contexts, we examined the extent to which their literacy standards emphasized global citizenship. Triangulating results from systematic counting procedures and critical discourse analysis of the Australian Curriculum’s General Capabilities and the U.S. Common Core State Standards, we found both standard sets to feature rhetoric that intimated global citizenship as national aims, but showed weak evidence of portraying and promoting global citizenship. We highlighted opportunities for each nation-state’s policymakers and practitioners to work within the boundaries of their standard sets so they can empower K-12 stakeholders to make access to global citizenship education more equitable.

[3] Ledger, S., Bailey, L., Thier, M., & Pitts, C. Powerful voices shaping the future of global education.
Seeking skilled intercultural communicators, OECD’s 2018 PISA battery will include a measure of global competency: the world’s first attempt at gauging education systems’ success in promoting peaceful, diverse communities. With an uncommon mixed methods application of critical discourse analysis (CDA) and social network analysis (SNA), we critique OECD’s positioning of global competency for its potential leverage on education policy in 72 participating nations. Our CDA and SNA findings converged around the people, power, and places most central to OECD’s approach to measuring global competency. CDA and SNA told complementary stories about OECD’s philosophies and processes. We conclude by challenging academics to better leverage their curricular networks and policymakers to seek a wider range of voices to inform policy directions.

[2] Thier, M., Beach, P., Martinez, Jr., C. R., & Hollenbeck, K. Take care when cutting: Five approaches to disaggregating data on rural schools.
Researchers neglect or incorrectly define geographic locale, impairing policy formulation, enactment, and evaluation. To examine researchers’ neglect for geographic locale, we systematically reviewed 108,504 peer-reviewed articles. Barely 3% of those articles addressed rurality; nearly no articles (0.2%) addressed remoteness. Our in-depth review of 10 highly esteemed journals identified 4,001 articles that addressed rural schools, although 91% of them failed to define rural. Given the epidemic failure in reporting geographic locale with any precision, we developed five statistical approaches to operationalize rurality and remoteness. Using the National Center of Education Statistics’ Urban-Centric codes with national data on Advanced Placement access, we found important variations in (a) proportional school counts as rural/remote, (b) effect sizes, and (c) characterizations of schools’ advantage or disadvantage. We discuss implications for policymakers and researchers who might otherwise draw inappropriate inferences from inadequate definitions of rural and/or remote places.

[1] Lucero, A., McClure, H. H., Martinez, Jr., C. R., & Thier, M. The role of cultural orientation and parent-child relationships in immigrant Latina/o adolescent academic achievement.
The purpose of this study was to investigate the influences of adolescent cultural orientation and parent-child relationships on academic achievement among immigrant Latina/o high school students in an emerging immigrant context. Data were collected as part of a study that investigated the ways in which acculturative processes and stressors influenced parent and youth adjustment to life in the U.S. The sample included 217 sixth- through 10th-grade adolescents who immigrated to the United States (M = 6.9 years prior [SD = 3.4]) with at least one primary parent. Results indicated that lower language conflict at baseline significantly predicted higher grade-point average (GPA) two years later; cultural orientation did not. Parental homework monitoring one year post-baseline mediated the relation between language conflict and GPA, appearing to buffer negative effects of language conflict in the home.
Book Chapters (n = 5)
Completed Evaluation Reports
& White Papers
(n = 5)

[5] Thier, M. (In press). Can Qatar buy sustainable excellence in education? In Y. Zhao & B. Gearin (Eds.), Imagining the future of education: Dreams and nightmares. Routledge.
Qatar, the world’s wealthiest nation per capita, faces interrelated education challenges. Despite a goal of trading fuel exportation for knowledge exportation, Qatar’s intelligentsia is lost to brain drain. Growing a new intellectual class is difficult: only 12% of the country’s 2.3 million residents are Qatari. The rest of the population is comprised of foreign workers. Qatari men have few incentives to pursue higher education because they can easily acquire low-skilled, public-sector jobs that feature shorter workdays, better pay, and more job security. The private sector demands education credentials. Qatari women, meanwhile, tend to be better educated, but are not welcomed in all labor sectors. To address these challenges, the ruling Al-Thani family has spent an estimated $33 billion USD to establish Education City, a “mega-university” of cherry-picked programs from Western nations.It is too early to tell if this unprecedented program will succeed, but Qatar’s reform efforts illustrate how its pre-Colonial and Colonial history continues to shape its capitalist present. 

[4] Gearin, B., Hameed, S. A., Christensen, M., & Thier, M. (In press). Educating for nationalism in an age of educating for economic growth. In Y. Zhao & B. Gearin (Eds.), Imagining the future of education: Dreams and nightmares. Routledge.
After World War II, many Western nations shifted missions from educating for common culture and democratic participation to educating for global economic competition. In hindsight, focusing on “college and career readiness” over “civics and human decency” looks like a misstep. The recent uptick in right-wing nationalist movements suggests that the continuation of democracy cannot be taken for granted, even in economically powerful and historically liberal nations. To explore tensions between educating for nationalism and educating for prosperity, we consider parallel reform efforts in Indonesia and Singapore, raising feasibility questions about trying to achieve “college and career readiness” simultaneously with “civics and human decency.”

[3] Thier, M., Fitzgerald, J., & Beach, P. (In press). Partitioning schools: Federal vocational policy, tracking, and the rise of 20th-century dogmas. In G. Lauzon (Ed.), Educating a working society: Vocationalism, the Smith-Hughes Act, and modern America. Charlotte, NC: Information Age.
This chapter traces the history of major U.S. education policies that deposited students inequitably into tiers. Overall, we review federal education policy contexts from the Common School movement in the mid-1800s to the passage of the Common Core State Standards in 2010. We: 
1. highlight roles that landmark legislation (e.g., Smith-Hughes Act, 1917) and impactful reports (e.g., Cardinal Principles of Secondary Education, 1918) played in producing a two-tiered high school system in the United States
2. demonstrate the maturation of that system amid Civil Rights-era policies (e.g., Elementary and Secondary Education Act of 1965) and how the controversial report, A Nation at Risk (1983), crystallized divisions within schools
3. situate academic tracking amid the policy churn of the new millennium: No Child Left Behind Act of 2001, Carl D. Perkins Vocational and Technical Act of 2006, Race to the Top in 2009, and the Common Core State Standards.

[2] Beach, P., Thier, M., Fitzgerald, J., & Pitts, C. (In press). Cutting-edge (and dull) paths forward: Accountability and Career Technical Education under the Every Student Succeeds Act. In G. Lauzon (Ed.), Educating a working society: Vocationalism, the Smith-Hughes Act, and modern America. Charlotte, NC: Information Age.
As the No Child Left Behind Act demonstrated, the measures in state accountability systems influence what knowledge and skills are prioritized in schools. NCLB’s emphasis on testing students in literacy and numeracy clearly left behind school outcomes related to career and technical education. With the arrival of ESSA, career readiness may have a chance to catch up. In this chapter, we explore the status of college and career readiness indicators, mainly through case studies of four states’ Elementary and Secondary Education Act flexibility waivers and California’s decision not to file a waiver. First, we contextualize the current state of college and career readiness, highlighting the flexibility ESSA provides states in creating accountability systems and measuring school quality. Second, we present lessons from five state’s accountability systems. Third, we examine the Linked Learning Alliance, International Baccalaureate’s Career-Related Programme, and Washington State’s CTE Course Equivalency Frameworks as examples that can enable individual schools and districts to foster integrated pathways, develop structured policies, or offer programs in which students’ educational experiences reflect a balanced emphasis on readiness for multiple future pathways, rather than pitting college or careers as mutually exclusive alternatives.

[1] Thier, M. Globally speaking: Global competence. (2015). In Y. Zhao (Ed.), Counting what counts: Reframing education outcomes. Bloomington, IN: Solution Tree. Pp. 113-132.
A limitation with the current definition and measure of quality of education is its failure to consider the fact that in the globalized world, the ability to interact across cultural, linguistic, and political boundaries has become essential. One’s perspective of, attitude toward, and ability to work with people from different cultures and different nations have direct impacts on one’s own success as well as the well-being of the world as a whole. This chapter explores various measures of global competence and the degree to which they would be useful and/or suitable for use in K-12 schools. This chapter received the Outstanding Graduate Student award from the American Educational Research Association’s special interest group in Educational Change.

Completed Evaluation Reports and White Papers
[5] Thier, M., Fukuda, E., Knight, S., Sykes, J., & Chadwick, K. L. (2017). Alignment and coherence of language acquisition development in the International Baccalaureate Middle Years Programme. The Hague, Netherlands: International Baccalaureate.
The International Baccalaureate (IB) has authorized more than 1,300 schools in about 145 countries to offer its Middle Years Programme (MYP) to learners aged 11 to 16. One of the MYP’s unique features is its focus on second-language acquisition, which the MYP codifies in its Language Acquisition Guide (MYP Guide). This study examined the alignment and coherence of the MYP Guide, and involved five phases: a literature review, a within-document analysis, a cross-document analysis, a progression analysis and a discrepancy analysis. Examining literature review findings alongside results from within- and cross-document analyses, researchers determined that the IB could consider attending to specificity and exemplification in some areas, but not universally across the MYP Guide. The researchers also recommended that the IB begin conversations about the scope and purpose of change before making any decisions about what in the MYP Guide requires revision, how to approach that revision and to what extent revision is advisable.

[4] Thier, M., Beach, P., Lench, S. C., Austin, E., & Coleman, M. (2016). More than one C: Educating students to be ready for Careers and College. Prepared for the California Education Policy Fund. Eugene, OR: Educational Policy Improvement Center.
This policy brief from EPIC discusses the United States’ bias toward college-going as the gold standard and how to counteract that singular mode of thinking. EPIC outlines why definitions of K–12 success should balance an emphasis on each C (college and career). EPIC also shows the related pitfalls of districts failing to attend to the issues that are most salient for their communities. To avoid those dangers, EPIC recommends democratizing postsecondary pathway access to ensure equity, localizing districts’ definitions of success to suit community needs, and personalizing educational experiences so students can become ready on their own terms.

[3] Beach, P., Thier, M., Lench, S. C., & Coleman, M. (2015). From accountability to actionability: Making sense of multiple measures through Local Control Accountability Plans. Prepared for the California Education Policy Fund. Eugene, OR: Educational Policy Improvement Center.
EPIC’s latest policy brief reviews promising practices from California districts as well as insights from research on multiple measures to provide recommendations that improve how California districts generate, present, and use data in their Local Control Accountability Plans (LCAPs). LCAPs represent a promising shift in school accountability policy by requiring districts to develop strategic plans designed to meet local needs. Inherent to the success of LCAPs is the use of multiple measures to describe a district’s theory of action and to assess the effectiveness of subsequent implementation efforts. However, the sheer volume of information within LCAPs can make it difficult for stakeholders to ascertain a district’s plan for improving student outcomes and for knowing when a district is performing well and when they are not. To realize the full potential of LCAPs, districts must help stakeholders make sense of “multiple measures.” Together, the three recommendations below can help districts develop a coherent theory of action, present actionable information, and define what success means locally. We recommend that districts (a) use multiple measures to develop greater coherence between inputs, processes, and outcomes linked to specific LCAP goals; (b) employ the matrix approach to monitor progress over time and as a communication tool for internal stakeholders; and (c) create infographics and narrative descriptions as a means to communicate critical information to external stakeholders. Understanding how districts and their stakeholders make sense of multiple measures and use data generated from LCAPs to improve the college and career readiness of students might determine the success or failure of California’s revised accountability system. However, LCAPs can benefit districts and schools regardless of the accountability implications. LCAPs can become the vehicles to improve the college and career readiness of students by harnessing community assets and tapping into the expertise of educators through informative and useful data.

[2] Beach, P., Thier, M., Lench, S. C., & Coleman, M. (2015). Defining a new North Star: Aligning Local Control Accountability Plans to college and career readiness. Prepared for the California Education Policy Fund. Eugene, OR: Educational Policy Improvement Center.
In this policy brief, EPIC recommends that college and career readiness serve as the “North Star” in California’s recently reformed accountability system. A district seeking to use its Local Control Accountability Plan (LCAP) to promote a college- and career-going culture should take the following steps: (a) adopt, modify, or generate a consistent and shared definition of college and career readiness; (b) evaluate the current LCAP for alignment to that definition; and (c) revise the LCAP to align with college and career readiness as its new North Star. By following these steps, district leaders will help ensure that the goals and actions outlined in their LCAP describe a coherent system instead of a collection of eight competing priorities.

[1] Conley, D. T., Beach, P., Thier, M., Lench, S. C., & Chadwick, K. L. (2014). Measures for a college and career indicator: Final report. Prepared for the California Department of Education Public Schools Accountability Act advisory committee. Eugene, OR: Educational Policy Improvement Center.
In 2012, California Senate Bill 1458 added a measure of college and career preparedness to the Academic Performance Index. The Public Schools Accountability Act Advisory Committee was charged with making recommendations to the State Superintendent of Public Instruction and the State Board of Education regarding measures that could serve as indicators of college and career preparedness at the high school level. EPIC was commissioned to evaluate potential measures identified by the Committee. This project also featured six topic-specific papers: on college admission exams, advanced coursework, course-taking behavior, innovative measures, career preparedness assessments, and multiple measures.
Share by: