future problem solving 2023 results

BRAND NEW Future Problem Solving Resource Library. We’re just getting started and are still uploading content. Keep an eye out for additional articles and free tools in the coming months.

• Global Issues
• Community Projects
• Creative Writing
• Storytelling
• Problem-Solving Method
• Real World Issues
• Future Scenarios
• Authentic Assessments
• 5Cs of Learning
• Youth Protection
• DEIB Commitment
• International Conference
• Find FPS Near Me
• Partner With Us

Who are the winners of the IC 2024 competition?

[ic 2024] photography and yearbook information, where can i find livestreams and videos of the international conference, what happens at the international conference, who gets invited to attend the international conference, when and where is the international conference held, can i compete in more than competition at the international conference, what does it cost to attend the international conference, when does ic registration take place, where do those attending the international conference stay, what is magic (multi-affiliate global issues competition), what is the fps experience, what is the excellence in project management award, what is the beyonder award, how does the global issues (gips) ic competition work, how does the action plan presentation portion of the ic competition work, how does the magic competition work, how does the community projects (cmps) ic competition work, how does the ic scenario writing (sw) competition work, how does the scenario performance (scp) ic competition work, how can i prepare for attending the international conference, what ic events can non-participants attend as an observer, [ic 2024] what is the schedule for this year’s event, [ic 2024] what sessions/workshops are available with this year’s event, [ic 2024] where is check-in located for this year, [ic 2024] where is parking located for this year, [ic 2024] what are the housing accommodations like, [ic 2024] how does the meal plan work, [ic 2024] what safety protocols are in place to protect students, [ic 2024] transportation and off-campus tours.

• Best Practices
• Everything Else
• Get Involved
• Get Started
• Problem Solving Tools

April Michele

• Academic Scholarship
• Outreach Grants
• Other Tournaments
• Certification Information
• QR Online Quiz
• Search QR Numbers
• FPS Clinics
• Search FPS Numbers
• Composition Certification Quiz
• Search Comp Numbers
• Board of Directors
• Board of Directors Information
• KAAC Hall of Fame
• Photo Galleries
• Writer/Editor Pay Request
• Competitions
• State Finals

Future Problem Solving

• Governor’s Cup FPS
• Start a Team
• Community Problem Solving
• Scenario Writing
• Scenario Performance
• Junior Division FPS
• Individual FPS
• Alternate FPS
• Glossary of Terms

FUTURE PROBLEM SOLVING

Competition for 21st Century Learning Skills

Future Problem Solving Program International is celebrating 50 Years!

The year long celebration will culminate with the Future Problem Solving International Conference June 5-9, 2024 at the University of Indiana Bloomington.

Kentucky teams who place at our State Finals in March may earn an invitation to the International Competition to represent Kentucky on the world stage.

Kentucky has been a part of Future Problem Solving since 1988 with multiple top 10 finishes at the International Competition.

Kentucky: One of the International Leaders in FPS

Future Problem Solving (FPS) helps students obtain lifelong goals by teaching problem solving skills today. The diverse components of this internationally recognized, award-winning program prepare students for emerging new realities.

The Institute for Competition Sciences has recognized KAAC as the number one FPS affiliate in the world.

KAAC offers FPS through Governor's Cup Team FPS and FPS Component Events .

What is FPS?

Through academic competition, students apply critical thinking, advanced problem solving, and decision making skills to hypothetical future scenarios using the following FPS Six-Step Process:

• Step 1: Identify potential challenges or concerns from the Future Scene.
• Step 2: Identify a singular underlying problem.
• Step 3: Identify potential solutions to the underlying problem.
• Step 4: Develop criteria to judge potential solutions and their positive impact.
• Step 5: Evaluate and rank the potential solutions using criteria to rank solutions in order of importance.
• Step 6: Develop a complete action plan based on the highest-ranking solution.

Component Events

• Community Problem Solving (CmPS) - An individual or team of students work to identify a problem that exists in their school, community, state, or nation. Participants utilize the Six-Step Process to examine this area of concern, then develop and implement real-world projects to address these problems.
• Scenario Writing - Individual students write 1500-word stories related to one of the five yearly FPS topics. Each fictional story must be set at least 20 years in the future and outline logical events taking place in the world.
• Scenario Performance - Individual students develop and deliver oral stories related to one of the five yearly FPS topics. Each oral story is set 20 years in the future and should be told in a natural and spontaneous nature that is creative and entertaining to an audience.
• Junior Division FPS - A team of four students in grades 4-6 may participate in the Junior Division of FPS.
• Individual FPS - Individual students work through the FPS Six-Step Process and have two hours to complete a booklet. Individuals generate eight challenges in Step 1 and eight potential solutions in Step 3. The other steps are the same as the team competition.
• FPS Alternates -The FPS Alternates competition is for students who are part of a team that qualified for the State Finals, but are not actually competing in Governor’s Cup team FPS. The FPS Team Alternates Competition is held at the Governor’s Cup State Finals. It is NOT part of Governor’s Cup. Each FPS Alternates Team will consist of not more than four students from different schools who work through the FPS process. Each team generates 8 challenges in Step 1, and 8 solution ideas in Step 3. Step 2, Step 4, Step 5 and Step 6 are exactly the same as the team competition. Participants have 90 minutes to complete a booklet.

Don’t let your FPS questions go unanswered. We’re here to help. Give us a call at (502) 223-0088 or email us at Chris Hill .

Future Problem Solving Program

Ages: Elementary, Middle School, High School

Types: Submission, Tournament, Fair, Performance, Presentation

Scope: International

[email protected], [email protected]

Participate

Founded in 1974 by creativity pioneer, Dr. E. Paul Torrance, Future Problem Solving Program International (FPSPI) stimulates critical and creative thinking skills, encourages students to develop a vision for the future, and prepares students for leadership roles. FPSPI engages students in creative problem solving within the curriculum and provides competitive opportunities.  Future Problem Solving Program International involves thousands of students annually from Australia, China, Hong Kong, India, Japan, Korea, Malaysia, New Zealand, Portugal, Singapore, Turkey, United Kingdom, and the United States.

The Future Problem Solving Program involves four competitive challenges including: (1) Community Problem Solving, (2) Global Issues Problem Solving, (3) Scenario Writing, and (4) Scenario Performance.   Community Problem Solving challenges students to think systematically about problematic situations, to gather information to understand the situation, and to evaluate multiple solutions in order to best address the situation? Students involved in Community Problem Solving (CmPS) learn powerful lessons about creating change, about dealing with local authorities and organizations, and about making a positive impact. Community Problem Solving students create and submit a Project Report that is reviewed by expert problem solvers from FPSPI. The top Community Problem Solving projects are invited to the FPSP International Conference in June each year.   Global Issues Problem Solving (GIPS) is a competitive component of FPSPI which can be accomplished as a team (of 4) or individual activity in which participants research a series of global topics and learn a six-step creative problem solving process. Problem solvers apply their topic and creative problem solving knowledge to address a charge presented in an imagined situation, termed Future Scene. Trained evaluators score student work and return it with feedback including suggestions for improvement. The top scoring teams and individuals on the qualifying problem are invited to Affiliate FPS Competitions. The winners of each respective Affiliate FPS Competition advance to the FPSP International Conference in June. Four divisions are offered:Junior (grades 4-6), Middle (grades 7-9), Senior (grades 10-12), and Adult.   Scenario Writing  is a competition in which individuals (grades 4 – 12) develop short stories related to one of five FPS topics for the year. The story (1500 words or less) is set at least 20 years in the future and is an imagined, but logical, outcome of actions or events taking place in the world today. The first place winner in each Affiliate Program is invited to the FPSP International Conference. Each Affiliate Director may submit its top three scenarios to the International Scenario Writing Competition. The top 5 international winners in each division are invited to the International Conference in June. Three divisions are offered: Junior (grades 4-6), Middle (grades 7-9), and Senior (grades 10-12).   Scenario Performance (ScP) was designed by FPSP Australia to develop and sustain the oral tradition of storytelling. Essentially, ScP is for students who enjoy telling stories. This option is ideally suited to students who show thinking abilities in different ways - particularly for those whose cultural heritage and/or learning styles prefer oral communication. Scenario Performances are connected to the annual FPSPI Scenario Writing topics as participants develop futuristic stories to present in a creative and entertaining manner. The stories do not have to be written, rather they are performed! Students are challenged to create a story that is between 4-5 minute duration, set at least 20 years in the future, and arises from any one of the topics set for Scenario Writing in the FPS year. Submission will take the form of a video file of the student delivering an oral telling of their story, undertaken in one take without any edits. The use of any props or aids, beyond the use of their voice, is forbidden. The performer may reference 15 cue cards (4x6 inches).  

FPSPI - International 1st Place

Team Award. $1000.

This award counts toward these ICS Academic Badges. Click on a badge for further info.

This badge demonstrates expertise in conducting a logical analysis of situations around us and creating innovative solutions to complex problems.

FPSPI - International 2nd Place

Fpspi - participation.

Team Award. $0.

Any student who completed participation in an FPSPI competition.

FPSPI - International 3rd Place

Team Award. $500.

Website: http://www.fpspi.org/

Managing Organization: Future Problem Solving Program International, Inc.

Contact: [email protected], [email protected]

Eligibility: Each FPSPI Affiliate Program determines its own processes, fees, and due dates for registration and entries. Your Affiliate Director can provide you with registration and submission materials and may be able to put you in touch with experienced FPSPI Coaches. See the competition website for more details.

Signup Newsletter

Sign me up for the newsletter!

The Institute of Competition Sciences (ICS) was founded in 2012 to help transform learning into an exciting challenge for all students. We exist to support students in realizing the full potential of their future.

Quick Links

• Competitions
• Privacy Policy
• Terms and Conditions

Connect with us on social media

Copyright © 2024 Institute of Competition Sciences. All rights reserved.

Global Issues Problem Solving

• Community Problem Solving

Scenario Writing

• Scenario Performance
• 2024 Registration
• Expression of Interest
• Resources for Purchase
• Downloadable

50th Anniversary of Future Problem Solving

This year marked the 50th Anniversary of the International Conference for the Future Problem Solving Program and was held onsite at the Indiana University, Bloomington, Indiana, a beautiful campus.

We would like to thank all of our students that represented us at this conference and their supporters. You always do us proud. We produced some spectacular results at the 2024 International Conference. Go team! Together with two Adult Service Awards, New Zealand brought home 13 trophies this year.

GLOBAL ISSUES PROBLEM SOLVING

Team competition.

JUNIOR DIVISION

1st - Northcross Intermediate Isobel Carmichael, Jason Hao, Jonathan Xu and Yigu Ye Coach : Glenis Martin

9th - St Andrew's College Prep Zilong Chen, Benjamin Edward, Louis Hyland and Emmett Lawler Coach : Sonia Lewis

MIDDLE DIVISION

4th - St Margaret's College Sneha Datla, Kieva Hanlon, Phobe James and Tilly O'Donnell Coach : Bridget Compton-Moen

6th - Kristin School Junyi Guo, Oliver He, Jonathan Hu and Matthew Lee Coach : Helen Mansfield

7th - Northcross Intermediate Alan Li, Alex Xiao, Vincent Xu and Andy Yang Coach : Glenis Martin

MAGIC Competition

In this Global Issues Problem Solving competition, teams of 3 or 4 students from different affiliates compete together as a team for the first time. Quite the challenge.  

3rd - Westlake Girls' High Charlotte Smith (NZ) Maithili (California), Emily (Washington) and Kai (Utah) Coach : Kameron Sadler

SENIOR DIVISION

1st - Cashmere High William Dyhrberg (NZ) Kate (Australia), Jonathan (California) and Evan (Nebraska) Coach : Sue Williams

3rd - Cashmere High Abby Laird (NZ) Jessica (California) and Akiva (Florida) Coach : Sue Williams

PRESENTATION OF ACTION PLAN

3rd - St Andrew's College Genevieve Bainbridge-Smith, Maja Clark, Alexa Collis, Alyssa Geddes, William Nicholls and Sophie Schouten Coach : Sonia Lewis

SCENARIO WRITING

Individual competition.

2nd - Cashmere High School Moss Turner Coach : Sue Williams

6th - Cashmere High School Naomi Wilson Coach : Sue Williams

HONOURABLE MENTIONS

Community problem solving.

5th - Kristin School (One place away from a trophy) Project - Worlds within Words Jerry Chen, Matthew Lee and Sabrina Liu Coach : Helen Mansfield

Team Finalists

Kristin School Gloria Dai, Andrew Gao, William Huang and Richard Wang Coach : Helen Mansfield

St Cuthbert's College Isobel Denton, Julie Sung, Bonnie Wang and Olivia Wei Coaches : Susan Jackson and Jan Walls

Individual Finalist

Nelson College Troy Kelso Coach : Sarah Watts

Northcross Intermediate Isobel Carmichael, Jason Hao, Jonathan Xu and Yigu Ye Coach : Glenis Martin

Kristin School Junyi Guo, Oliver He, Jonathan Hu and Matthew Lee Coach : Helen Mansfield

Northcross Intermediate Alan Li, Alex Xiao, Vincent Xu and Andy Yang Coach : Glenis Martin

St Margaret's College Sneha Datla, Kieva Hanlon, Phobe James and Tilly O'Donnell Coach : Bridget Compton-Moen

St Cuthbert's College Isobel Denton, Galathée Gaillard, Julie Sung, Zara Toes, Bonnie Wang and Olivia Wei Coaches : Susan Jackson and Jan Walls

ONE SPOT AWAY FROM BEING A FINALIST

Takapuna Normal Intermediate School Aida Thompson Coach : Rhea Anglesey

MIDDLE INDIVIDUAL DIVISION

St Cuthbert's College Zara Toes Coaches : Susan Jackson and Jan Walls

ADULT SERVICE AWARDS

25 Years Service Award Julie Styan - National Co-Director

5 Years Evaluation Award Robyn Boswell QSM - Retired National Director

Please click here for a list of our 2023 National Finals results: 30th Anniversary

Please click here for a list of our awesome 2023 international finals results.

Future Problem Solving NZ

Teaching students critical thinking, creativity and colloboration.

Competition results, fps competition results, celebrating students and their hard work.

Throughout the school year, Global Issues students participate in a 2 practice competitions and 1 qualifying competition.   Community Problem Solving, Scenario Writing, and Scenario Performance work throughout the year and have one submission for the entire year that is evaluated on the State level.  If students qualify for the state competition, they will compete at the State Bowl in April.  After which, the top students in the state of Texas have the opportunity to compete at FPSPI International Conference in June.

links to current and previous fps competitions

It is a privilege to celebrate the hard work of each of the students that participates in FPS.  Although not all may get an award and place, each student should be proud of what they have accomplished during the year!

2022 State Competition Results

                                                                    2023 State Qualifier Results – These are the students that qualified to compete at the State Bowl April 14-16th in Waco, TX

Government agencies communicate via .gov.sg websites (e.g. go.gov.sg/open) . Trusted website s

Look for a lock ( ) or https:// as an added precaution. Share sensitive information only on official, secure websites.

Future Problem Solving Programme Finals

We are delighted to host the Future Problem Solving Programme 2023 National Finals (Hybrid) at our Braddell Campus.

The Future Problem Solving Programme (FPSP) is an excellent vehicle to teach problem solving strategies across the curriculum while promoting the development of 21st Century Competencies within the students. This year, students showcased their action plans under the theme of ‘Mining’.

This year’s event also saw the inclusion of a Community Problem Solving (CmPS) Programme exhibition where students showcased meaningful approaches to solve real life problems within the community of their choice.

Platforms such as these also allow students to engage with their peers from 12 primary schools and 10 secondary schools & JCs across Singapore.

RGS has been the national convenor of the FPSP since 2009 and we look forward to hosting many more initiatives over the coming years.

Read more: [https://www.fpsp.org.sg/]

Problem 

“opening doors to the future”.

2024 I C International Conference & State Bo wl Spotlight coming soon. Here's what happened in 2023

Ranks of royalty   click on 2024 state bowl to see nc fps state champions 2024 state bowl qualifying problem    .

Click her to read winning 2023 SCENARIOS

Click her to see nc fps's  2023 cmps projects.

2023 International Conference: Currency

NC FPS students take the stage at 2023 International Conference...

1st place GIPS Individual Junior Division Arora

Coach Harrison

6th place GIPS Team Junior Division  Baer, E Huffstetler, L Huffstetler, Lam

5th place GIPS Individual Middle Division  Venkatesh

Coach Venkatesh

Finalist GIPS Team Middle Division

Nanduri, Patil, Sattenapalli, Unnikrishnan

Coaches Nanduri & Shyamala

Finalist FIPS Individual Senior Division Mehta

Coach Mehta

Finalist GIPS Team Senior Division  Coleman, Cone, Hart, Lam

Finalist  GIPS Team Senior Division E  Nethala, E Nethala, Sureshkannan, Varikuti

Coaches Vanipalli & Venkatesh

4th Place Presentation of Action Plan Senior Division  Coleman, Cone, Hart, Lam

MAGIC = Multi-Affiliate Global Issues Competition

1st place MAGIC Ju nior  Division Jangala

Coach Jangala

2nd place MAGIC* Junior  Division Sharma

1st place MAGIC* Middle  Division Sakhalkar

Coach Sureshkannan & Vanapalli

4th place MAGIC Middle Division Samatam

1st place MAGIC* Senior Division Vanapalli

Coach Nanduri & Shyamala

​ Finalist CmPS Team Junior  Division Positive Pollinators

5th place Junior Division Scenario Zhang

Coaches Sureshkannan & Vana palli

24-25 TOPICS  PP1  Food Security PP2  Rising Sea Levels QP Agricultural Industry SB  Nanotechnology IC announced in March

TO FIND THE BEST SOLUTIONS, YOU MUST ASK THE RIGHT QUESTIONS.

Registration for New 24-25 Teams & Individuals in all components available in September. Click here to learn more.

Plan ahead  2025 nc fps state bowl ymca blue ridge assembly friday, april 4th  through sunday, april 6th   black  mountain , north carolina topic: nanotechnology.

WISCONSIN FUTURE PROBLEM SOLVING 

What is Future Problem Solving (FPS)?

We are a nonprofit educational program for K-12 students

and adults. Founded in 1974 by Dr. E. Paul Torrance,

our goal is to inspire creativity and encourage

the development of a positive vision for the future.

Through participation in FPS students:

Develop and enhance creative and critical thinking abilities

Increase global awareness of and interest in the future

Learn and apply problem-solving strategies

Develop teamwork skills

Improve oral and written communication

Exercise critical and analytical thought

Extend perceptions of the real world

Explore  and problem solve complex societal issues

Develop, utilize and improve research techniques

For a quick video overview  of our program, click here 

WHAT'S NEW?

2024 International Competition 

Congratulations to our global winners!

Annabel Goldberger, Middleton High School -- 4th Place Scenario, Senior Division

Max Yablon, Shorewood Elementary -- 3rd Place Global Issues Individual, Junior Division

- - - - - - - - - - - - - - - - - - - - - - - - -

2024 State Bowl 

The 42nd Wisconsin State Bowl was held in person at the Green Lake Conference Center April 18-20.  Find a list of all winners here!

Click below  for a short video of the Bowl!

2024-25 TOPICS

Food Security    (Practice Problem #1)

Rising Sea Levels    (Practice Problem #2)  

Agricultural Industry   (Qualifying Problem)

Nanotechnology   (State Bowl)

FPS Alumni -- Please Keep in Touch!

We continue to make a concerted effort to get in touch with as many Wisconsin FPS alumni as possible.   Click here  for the alumni page.

A HUGE THANK YOU!

Our deepest thanks to Alpha Delta Kappa who provided a generous $1000 grant.  Their contribution will help us continue to offer programming to many students throughout Wisconsin.  

Thanks for submitting!

We teach students how to think,

not what to think!

DONATE TODAY!

Our Partner

WATG is dedicated to fostering a climate that allows each individual to reach their unique potential

Click on the logo above to access Future Problem Solving International

Become an Evaluator

P roviding feedback to students is a way to give to our program.  Evaluators may be FPS coaches, other teachers, parents, or any interested individual.  Senior division students in grades 10-12 who have been on a Global Issues team for at least two years may also evaluate.  Click on the button below for more information.

"FPS helped me to develop critical thinking skills in middle school and high school that helped prepare me for engineering courses.  The process also contributed towards my involvement in extracurricular activities at college."

Dan Jonovic, Integration Engineer at Epic

    Non-Discrimination Policy

Wisconsin Future Problem Solving does not discriminate in violation of the law on the basis of race, religion, creed, color, sexual orientation, age, physical challenge, nation of origin, gender, or any other trait. All participants are welcome in Wisconsin Future Problem Solving.

Programs  >  Topics

Tourism not only benefits host locales but those on holiday. Travel enriches their lives, expands their understanding of people and cultures, while also serving as a respite from daily life. The economic stability of such destinations depends on the sustainability of their tourist trade. As the popularity of such destinations grows, international corporations and developers typically flock to these growing places, trying to capitalize on the financial possibilities. There is money to be made in building hotels, restaurants, and in developing an area’s growing tourism industry. As outside groups seek to attract tourists and the revenue they generate, locals often struggle to maintain their location's unique appeal and ability to support local venues. As this build-up occurs, local people can have their cultures exploited, lands destroyed, and their local businesses put in jeopardy. As the tourism sector grows and expands, we are seeing the expansion of the Special Interest (SIT) market - tourists wishing to match their vacations with their interests (e.g., ecotourism, wellness tourism, event tourism, ancestry tourism, etc.). How will changing forms and trends of tourism impact tourists and hosts alike? How can the advantages of expanding tourism be balanced with the protection of destinations?

Today nearly half the world's population lives in an urban area. By 2050, that number is expected to reach 70% due to this increase in Urbanization. Urban areas and their large populations often hold power over governance, economic development, and international connectivity beyond their immediate regions. With proper planning, urban centres can provide educational and economic opportunities to residents not found elsewhere. However, they can also easily give rise to slums and increase income inequality. With growing footprints, cities are also struggling to provide basic needs, essential services, and safety. Future urban planners must address tough questions: What qualities in society should be valued most? What is fair and equitable? Whose interests will be served first? Planners must balance the speed of decision-making with the need for thoughtful, well-considered programs for development. As urban areas expand, how can we develop areas that are efficient, resilient, and inclusive?

Antarctica, the highest, driest, coldest continent, has no permanent population and is governed by a collection of agreements between fifty-four countries. The Antarctic Treaty System designates the entire continent and surrounding waters for scientific endeavours, bans military activity, and promotes environmental research and preservation. Although Antarctica remains the most remote place on Earth, it is highly regulated and heavily impacted by activities around the globe. Parts of the continent are polluted by sewage, discarded machinery, fuel products, and rubbish. Antarctica is thought to be rich in minerals and resources, though an 'indefinite' ban on mining is in place through 2048. Antarctica also holds over 60% of the Earth's fresh water in an ice sheet that contains 90% of the Earth's total ice volume. As global temperatures rise, these are breaking apart and melting faster, endangering local wildlife and entire ecosystems. Without a consistent population or a sovereign state, Antarctica possesses a unique space within political, economic, and environmental crossroads. How can Antarctica be sustainably utilized yet simultaneously preserved to best benefit our global population?

Our transport needs, desires, and realities are rapidly changing due to global growth and increased connectivity. As modes of transportation continue to evolve, increasing levels of complexity and efficiency are pursued. What role will autonomous vehicles, cars, airplanes, ships, etc., which operate without human intervention, play in this pursuit? Their development continues to increase exponentially with advancing technological capabilities. Since all scenarios are not programmable, autonomous vehicles must learn and react. They do this by surveying their environment with multiple sensors and utilizing artificial intelligence (AI) to process vast amounts of data. Autonomous vehicles can deliver on demand, refuel, park, and store themselves. By creating a network of these vehicles, entire systems of transport could become autonomous, controlled by a central AI. How will the efficiency of autonomous vehicles affect the development of transportation, on land and sea, in the air, and possibly space? How will autonomous transport cope with unexpected risk situations and ethical decisions? In what ways will autonomous transport impact jobs, industries, infrastructure, and lifestyles?

Tourism Urbanisation Antarctica Autonomous Transportation Currency

Tourism Urbanisation Antarctica

Electronic devices are often replaced with the latest version at an alarmingly fast pace. These constant upgrades add to E-Waste significantly impacting the environment and reducing natural resources while consumer demand is being met. Tens of millions of tons of such materials are discarded every year worldwide. Electronic products are full of hazardous substances such as toxic materials and heavy metals that can threaten humans, plants, animals. One method of disposal often employed by developed states is to offload e-waste to low-income countries for resale or demolition. This offloading places developing nations at greater risk of exposure to toxic chemicals and materials. Meanwhile, the high rate of device upgrades in developed countries has significant consequences for both people and the environment. What impact does planned disposal have on the amount of e-waste? What incentives can be developed to promote software upgrades for existing devices? As the appetite for ever-increasing technological devices continues, what are the implications for how we dispose of these devices? How can more effective and ethical responses to recycling and disposal policies be encouraged to protect human life and the global environment in the future.

Technologically, virtual reality is widespread and expanding its application through augmented, enhanced, mixed, and other forms of digital realities. The options and opportunities for its application appear boundless through the integration of 3-D images, gaming, computer-assisted instruction, equipment simulators, and entertainment platforms. The imposition of holographic images over real-world views have applications ranging from education, archaeology, and engineering, to sports training, video games, and artistic expression. The utilization of augmented reality technology is already making significant changes to the manufacturing industry. What other industries will it revolutionize? The inclusion of haptic, visual, and auditory overlays can be both constructive and destructive to users. New opportunities are provided to individuals with disabilities. New treatments are made available to the ill. How will enhanced reality impact human interactions? Digital reality is constantly evolving with advantages for all fields. How will we deal with the fiscal, educational, and psycho-social issues that might arise?

Machines were developed to assist with dangerous and difficult jobs. At present, unskilled human labour is being replaced with robotics more quickly than at any time in history.  Advancements of such machines move technology closer and closer to lights-out manufacturing. In countries with robust national safety nets, these changes are viewed as inevitable, and they have begun to explore new human employment concepts. Robotic workers often provide for human safety as in the case of bomb disposal. Laborers are fearful of how these looming employment changes and uncertain of how their work life will proceed. A robotic workforce's effects go beyond manufacturing as university-trained individuals such as lawyers and accountants are already being impacted by automation. What will the human workforce of the future look like? Will specialized training and education be needed for a combined human and robotic workforce? What will our future work force look like? How will our future economy be impacted by robotics in the workforce?

Consumerism has promoted a 'throw-away' society – one in which people do not keep things for very long, preferring single-use and disposable items. This societal approach leads to overconsumption of short-term items instead of durable goods that can be repaired. Widespread social influencing often encourages people to focus on the consumption, ownership, and display of material possessions to mark an individual's social status, identity, and standing. This impacts the environment, lifestyles, and distribution of wealth. Consumerism stretches the world's limited natural resources. Production is dictated by consumer demand, and businesses try to provide consumers with a growing number of options, including branded goods, to stay afloat. Many products are often fads or are adapted and modified regularly to entice consumers to buy the upgrades despite already having durable ones. Constant upgrades are sought to achieve greater social standing through material possession instead of meaningful acts. How can societies value all their members while allowing for - and encouraging - individual perspectives and desires? What are the appropriate balances between local values and global aspirations for consumers?

E-Waste Digital Realities Robotic Workforce Throw Away Society

E-Waste Digital Realities Robotic Workforce

In many parts of the world, freshwater is in short supply. Water is often pumped for miles, streams diverted and reservoirs and dams are constructed to provide for the growing populations in dry areas. As water levels drop and aquifers decline, people become more concerned about preserving their water resources. More than 2 billion people lack access to safe drinking water services, and more than 4 billion lack safely managed sanitation services. Differing governmental and commercial demands must be balanced so that communities have enough safe water for their needs. As available water supplies deplete, adjacent areas begin to battle with water contracts and water rights. How might the right to access clean water be achieved? How will regulations shape the future of access to water? How will water scarcity shape society?

The world is now more urbanized than ever before, and more and more people are flocking to live in large cities. Singapore was once known as the ‘Garden City,’ now it is being promoted as the ‘Garden in the City’ as new buildings incorporate trees and other greenery in their designs. Many quickly growing population centers are more environmentally aware as they expand the living spaces for their citizens. This awareness is not just a case of saving the environment and reducing emissions; it is a matter of necessity for creating healthy cities. Buildings can be designed to conserve both energy and water while improving the indoor and outdoor environment. Advancing technology is changing how architects are incorporating sustainable living practices into buildings. Light-based modulated sunlight, improved insulation, enhanced ventilation, eco-friendly building materials – are a few of the ecologically-preferred innovations changing the face and function of buildings. Some buildings now incorporate wind turbines to provide the necessary energy to power the building. Will these developments solve the problems they have set out to address? Will these change the way cities work and the way people live in them? Will these changes improve safety during natural disasters or introduce new problems?

Insects - human's best friends and worst enemies. We are surrounded by more than a million species of insects. Without them, humankind couldn't survive. Some insects destroy crops and carry diseases. Mosquitoes, which carry diseases such as malaria, dengue fever, Ross River, Zika, and West Nile viruses, kill and maim more people each year than any other animal. Others do essential jobs like pollinate blossoms, aerate the soil, decompose dead plant material, or eat other harmful insects, making them essential to the food web. As weather patterns and temperatures change, the distribution and habitat of many insect species are likely to change dramatically. The numbers of bees around the world have been radically reduced due to disease. How does the reduction of some species and relocation of others impact health, agriculture, and horticulture?

Over 1,900 insect species have been identified as suitable for human consumption and animal feed and could assure food security. Incorporating insects into the human food and medical supply indicates the ever-growing importance of insects in the world. Will insects and their products, such as genetically modified mosquitoes or manuka honey help to fight diseases? Will toasted grubs, fried crickets, and other edible insects become important global protein choices?

Mining is a long-standing means of gathering a wide range of resources vital to aspects of everyday life. The growing demands of mined materials continues to see the mining industry expand at an incredible pace. The technologies in use today and projected for the future are more minerals intensive than ever before. While technology has made mining both safer and more environmentally sensitive than any other time in history, environmental and other risks remain. Yet without the collection of these important materials, the cornerstones of society like buildings, machines, and communication would not be possible. With environmental protections varying greatly from country-to-country, how can the world collaborate on the best way to extract and share geological materials? With mining as the foundation of countless communities, how will they be impacted by the changing landscape of mining? In the future, are there new areas that might be mined for resources?

Millions of children around the world participate in competitive youth sports every year. Involvement in organized sports teaches many essential life skills – teamwork, confidence, the value of hard work, and discipline. While some competitive sports promote activity and a healthy lifestyle, others build skills such as mental agility. The hyper-competitiveness of youth sports raises concerns that children are pushed too hard to win and succeed. The sports options for youth are also evolving, as competitive e-sports emerge. Competitive sports can heighten aggression, pressure to win, and put children – who are still growing and developing – at risk for injuries. In many places, increasing costs of club sport-memberships and insurance exclude those who need social interaction and fitness the most. The costs of maintaining and running facilities can also limit the accessibility for youth. How much should we push young people to participate in competitive sports? Do the benefits of structured competition outweigh the costs of over-competitive behavior and possible injury? How does participation in sports impact the well being of youth and their families?

Traditionally, clothing and accessories have all been developed to fill basic needs. They provide warmth, protection from the elements or injury, and even serve to attract attention. Recently, the industry for wearable technology has transformed the way we think about clothing and accessories. Wearables have rapidly expanded to include heating elements, internet connections, watches, body monitors, and more. As more people grow accustomed to wearables in their daily lives, the possibilities for what the technologies can do are virtually limitless. They already monitor vital signs, send information to medical professionals, and even give individuals the ability to soar like a bird in personal flight suits. Smart sports uniforms can now reduce and identify injuries by regulating body temperature, supporting muscles and tendons, and gauging the force of impact. Attire with virtual reality functions is currently being developed to push this sector even further. How will wearable technology enhance or jeopardize real-life experiences and connections with others? Where in the world could wearable technologies allow humans to survive? What advantages or disadvantages are inherent in the inclusion of technology in our clothing and on our bodies?

Humans have always impacted the environment. Over time, the effects have increased as industrialization, urbanization, deforestation, processing of natural resources, the burning of fossil fuels and more technologies have developed. Examples of human’s impact on the environment are everywhere.

Feeding the world’s growing population has adverse environmental effects such as overgrazing, deforestation, and agriculture-induced soil erosion. Water pollution from pesticides and fertilizers impacts the quality of water available for specific populations. Clearing of land and overfishing result in loss of biodiversity and disturbances to ecosystems. Industrialization and urbanization cause the release of toxic solid, liquid, or gaseous waste materials and are the catalyst for serious environmental hazards. Water pollution as a result of poor disposal of sewage wastes, solid wastes, and other industrial wastes, may spread diseases and create an unfit environment for human activities. Industrialization has also increased consumption of natural resources for the production of goods, leading to a significant loss of nonrenewable resources and excessive waste. Activities like mining and dam construction cause habitat destruction. Trends like “fast fashion” contribute to why the fashion industry is the second-leading cause of pollution in the environment. What are our challenges moving forward to create a balance between basic human needs and our need to preserve or create an environment that is fit for continued quality human existence and growth?

What if your doctor could diagnose you before you experience symptoms? Using information from an individuals’ genetic and molecular profile, researchers have begun to create patient-specific treatments with a level of precision never before seen. Personalized Medicine enables healthcare providers to use a patient’s cells to combat precisely identified diseases at an unprecedented pace.

Researchers at universities, biotech companies, laboratories, and pharmaceutical companies are continually making discoveries. Doctors and other healthcare professionals continue to explore how these discoveries can help patients and increase our knowledge about diseases. The pharmaceutical industry is developing medications that tailored to an individual patient’s genetic makeup. The costs of genetic tests are decreasing as their availability increases. Even with better affordability, how accessible will individualized advanced treatments be? Will insurance companies cover them? The increasing specificity of personal health information raises many concerns about the protection of personal data. How will Personalized Medicine account for the impact of external/environmental factors on an individual’s health?

Most people dream of visiting new and exciting places to experience culture, cuisine, and local entertainment through travel. Transportation technology makes it easier and faster than ever before to get from one country to another although travel can be very expensive and time-consuming for many people. Heightened safety concerns often mean changing security requirements and government screening processes for crossing borders.

Some experts believe that technology may begin to replace in-person travel. VR-AR-MR (Virtual Reality / Augmented Reality / Mixed Reality), are immediate, involving, engaging and immersive types of entertainment that can accessed anywhere in the world. This could cause travel to boom if people, having used these technologies, want to experience the world “for real.” People may be increasingly comfortable in both worlds: the physical real world, and the digital world that is constructed instantly and repeatedly to fit what each person wants and chooses, using immediately responsive networks.

How will the time, technology, and expense associated with travel impact the future of international travel and tourism?

Approximately one-third of our lives is spent sleeping. For nearly a century, scientists have been able to record brain activity and see the dynamic changes during sleep. Lack of sleep can affect brain function, especially memory, language, and emotional balance. Physical effects include fatigue, stress and health problems including heart disease and obesity. Today, technology on our wrists can measure sleep habits and movements.

Globally, businesses developing sleep aids are witnessing significant growth due to the rising incidence of sleep disorders. This has been exacerbated by the growing senior population. It is manifest in increasing demand for sleeping pills due to stressful modern lifestyles and increasing numbers of initiatives by various health organizations to increase awareness about sleep disorders. Sleep medications often have undesirable side effects and patents of major sleep drugs expire. Wakefulness aids, stimulants and prescription drugs such as coffee, energy drinks, benzodiazepines and even illegal drugs are gaining in popularity as a perceived solution to the need to perform effectively despite sleep deprivation.

How might our over-scheduled lives and increased digital presence disrupt natural circadian and sleep patterns? Can the benefits of sleep be replicated? What new technologies might be available to help people monitor and adjust brain wave activity during sleep? Will scientists discover more about the genes that enable functionality with less sleep?

Gamification isn’t just about leisure time digital or other games. Gamification applies the theories of game development that make games so alluring and creates sustained attention. Players and teams win points and rewards by completing designated tasks. Minecraft, for example, has been used by teachers for everything from computer science to social sciences to creative writing. Fitbit and tracking apps on the iWatch are increasingly popular and encourage competition – with yourself or with a group.
Gamification helps users focus on tasks that might normally be boring, and the process might be applied to fields such as customer loyalty, education, health, recreation, job training, self-improvement, household chores, fundraising, and activism. Gamification is being used by corporations to make marketing interactive, but it’s also being used to benefit individual health and well-being.

Is there a relationship between gamification and tech addiction? How might gamification impact education and learning, inside and outside formal schools, or even in the workplace? What are some of the ethical implications, particularly around user privacy? What role will companies have in the creation of tech products to “hook” their users or the use of gamification as an educational tool? Can gamification enhance human interactions?

Nearly half of the world’s population (more than 3.5 billion people) live in poverty. Of those 3.5 billion people, 1.4 live in extreme poverty, surviving on less than $US 1.25 per day.

Across the globe, many people struggle to have and sustain basic needs such as food, clean water, basic medical supplies, and adequate shelter. Some people are forced to leave their homes to travel to other places or countries to find menial work to send money home to support their families. Due to poverty, many people are unable to access education. Some adults deliberately suffer from malnutrition so that their children can have the food that is available. Children in severe poverty are often orphaned or they have been sent away because their parents cannot afford to care for them. Healthy food can be very difficult to come by for the poor due to lack of financial and monetary resources, meaning that they depend on cheap, unhealthy foods to sustain their lives.

What can be done globally to assist those suffering from extreme poverty? How can we reverse this trend in order to decrease the adverse impact of poverty on future generations?

A spacecraft in orbit? A biosphere on extraterrestrial ground? Private and governmental organizations are already planning missions to set up research stations or even colonies on the Moon and Mars. Many see opportunities to learn more about our solar system, leading to a better understanding of Earth and ourselves; others question whether such missions are even feasible. One private agency is already seeking volunteers for a Mars mission. Space ventures provide an impetus for advancing knowledge and technologies with applications in space, as well as on Earth. Entrepreneurial and scientific opportunities abound to explore, to mine, and to engineer under distinct conditions. Pioneers will need to plan for a sustainable long-term stay, which will require vast investments of people, money, and other resources

Drones are among the most hyped products for aviation enthusiasts in recent years. Although originally developed for military use, drones or Unmanned Aerial Vehicles (UAVs) can be cool gadgets used for recreation. They can also be powerful tools for commerce, scientific research, agriculture, entertainment, photography, transportation, disaster relief, search and rescue, surveillance, and policing. UAVs can carry payloads and can be controlled remotely by a human operator or by an onboard computer. Basic drone models can be operated with little skill or training. Regulations on the use of UAVs are already in place in nations around the world, but technological advancements and expanded applications may outpace their regulation. While UAV use is growing exponentially, concerns are also escalating. Privacy intrusion, airspace violation, criminal use, surreptitious military operations, accidental crashes, terrorist threats, and other issues have raised alarms.

What does the future hold for UAV technological advancements and accessory enhancements? Will access to UAVs be equitable? How will the pending prevalence of drones in our daily lives affect society overall, especially in areas of personal rights and safety?

Hunger remains a concern in the developing world, and the resources required for food production are limited. About one-third of food produced globally is lost or wasted, leaving millions of people hungry and valuable resources squandered.

Food loss refers to a decrease in food for human consumption during production, post-harvest, and processing stages. Causes include poor harvesting techniques, weak infrastructure (markets, transportation, storage, cooling, packaging), contamination (bacteria, fungus, insects), and corruption. In addition to reduced availability, food loss contributes to higher costs, hurting farmers as well as those who cannot afford to buy their food.

Food losses that occur at retail and consumption stages are called food waste and refer to behaviors such as discarding edible food. Quality standards based on perfect appearance, misused “best-before-dates,” and careless consumer attitudes contribute to waste. Food waste is more common in the industrialized world, while food loss is a greater concern in developing nations.

Can food loss prevention combat hunger and raise incomes in developing nations? Can food waste be decreased without sacrificing quality or safety? What roles might technology or regulations serve? What are the economic, environmental, psychological, and societal implications? Can we improve global food security while meeting the needs of diverse consumers?

With exponential change and fast-paced trends in society comes an increase in stress. Stress can be physical, mental, or emotional. Living conditions, as well as societal and personal expectations, can lead to higher levels of stress-related hormones. In some parts of the world, people find it difficult to cope with longer work hours and less leisure time as they attempt to meet society’s perceived expectations. Social media is a constant presence, delivering both subtle and overt pressures.

Most people experience stress, but individuals respond differently. Stress can be a useful motivator in the face of challenges or danger, but negative impacts can result from excessive stress. Medical and psychological problems can emerge or be exacerbated. Scientific data show that physical activity and relaxation techniques are samples of ways to reduce these negative impacts.

What are the personal and societal impacts of stress? Do different countries and cultures deal with stress the same way? How can we promote healthier lifestyles that help people to cope with stress?

Each year, approximately 52 million people suffer from infectious diseases around the world.  Seventeen million deaths per year result from these diseases. With affordable global travel and more people living in cities, infectious diseases may spread rapidly across the globe.  How can the spread of infectious disease be controlled?  How can the health of people around the world be safeguarded?

Toxic materials are everywhere: heavy metals in electronics, flame retardants in furniture and clothing, pesticides in our food, and harmful chemicals in plastics.  Poisonous chemicals are linked to cancer and birth defects.  Although certain chemicals are known to be hazardous, current regulation systems allow them to continue to be brought into homes via many products.  How can we become better aware of the dangers associated with toxic wastes?  What will happen if we increase our reliance on these materials? 

Philanthrocapitalism is a form of philanthropy in which entrepreneurial ideas, practices, and wealth are used to tackle global challenges. As the divide between rich and poor increases around the world, the number of billionaires is growing. Some of the planet’s wealthiest people have become philanthrocapitalists, pledging to invest time, energy, skills, ideas, and large amounts of money towards worthy causes. This may have a positive impact on the people, groups, and causes that are chosen for support, but there are questions about this form of philanthropy.

Will the efforts of philanthrocapitalists actually lead to deep, sustainable results? How will their causes be chosen? Do individual philanthrocapitalists have the expertise to address the world’s most significant problems? Will this model of philanthropy present conflicts of interest as it influences the priorities, donations, or behaviors of average people? Does philanthrocapitalism transfer the power and responsibility of social change away from governments and charitable organizations to an elite few? How might philanthrocapitalism benefit or harm the generations of the future?

Biosecurity is a worldwide, cross-border problem. With the number of noxious pests, plant diseases, genetically modified crops, and displaced species increasing around the world, monitoring and controlling the movements across national borders is becoming increasingly difficult. Environmental changes may exacerbate the problem by altering the range of habitats and upsetting the natural balance. Equally difficult and a major concern is the implementation of measures to reduce the effect of these current issues on native flora and fauna as well as serious damage to exports. Even though a number of countries have stringent safeguards in place already, smuggling or lack of knowledge makes policing biosecurity difficult. Some countries have little or no policy for restricting the movement of plants and animals across borders. Customs officers can make some positive impact, but they are limited by the constraints of their job and the porous nature of many borders. Besides, what seems like necessary safeguards to some are seen as unnecessary constraints on trade and economic growth to others. How might development in new technologies assist in regulating and monitoring biosecurity issues? How can countries cooperate with each other in dealing with cross border contamination?

Education is considered to be the pathway to an informed, future-focused population. In many countries, education is publicly funded by the central government or by state governments, with options for privately funded schools. In some countries, school funding/regulation is largely local and tied to property taxes. Other countries struggle to fund education at all. In addition to differences in funding, other economic and social factors contribute to educational disparities: family earnings, health status, gender, political participation, and social class.

Who should provide educational funding? Should intervention occur in communities or countries where social factors influence the quality of educational opportunities? Already, some international programs such as International Baccalaureate or international exams like Cambridge and PISA claim to give a fair indication of educational achievement around the world, but do results help or harm educational equality? As connectivity spreads around the world, how will universal access to interactive and personalized networks of education evolve? Will access to these virtual networks equalize opportunities in the future?

The genes of organisms can be altered using biotechnology techniques. New genes can be inserted into plants and animals to create new varieties and breeds or to lessen certain genetic activity such as susceptibility to disease. Since 1970 GM has helped produce greater numbers of crops with higher nutritional value and has been prominent in animal agriculture. Critics claim there are serious ethical, ecological, and economic issues with GM techniques. For example, GM crops can cross-pollinate with non-GM crops creating unpredictable characteristics in plants. Bioherbicides and bioinsecticides can be added to crop seeds, but are not always effective. Resistant weeds now infest 75 million acres of land across the world. Domesticated animals are being genetically modified to produce proteins that have applications for human medicine – proteins to control blood clotting or kill cancer cells, for example.

What will be the long-term impact of genetic modification of plants and animals? If plants and animals are genetically modified to resist current pathogens, will new, more resistant pathogens develop? Already, GM has led to international controversy and trade disputes, protests, and restrictive regulations on commercial products containing genetically modified organisms.

The developments in the use of technology in the medical field have been dramatic in recent years, covering both issues of medical treatment and the delivery of medical services. For instance, the use of advanced electronics in the production of prostheses and other organ replacements has given some sign of the possible extent of technology application into the future. With greater technology advancements, very expensive and specialised disposable items are being used during surgical and medical treatments.  It is suggested that in the near future an inability of access to these technologies for public or poorer private patients will lead to a resurgence of more basic reusable equipment being favoured.

With more advanced devices, there may also be problems with medical workforces, as company representatives  may be the only people specifically trained to use the technology, rather than medical staff. Medical robots may be replaced by sentient beings or robots comes into play, as well as patients a inspected by virtual doctors  Patients may also be able to ‘print’ their own drugs at home, bypassing the pharmacy system. All these developments have and will have implications for government regulation, the cost of healthcare (and who pays for it), as well as the impact on social relationships and community-based service employment that, in this decade, is the main form of employment.

Identity theft is a form of stealing someone’s identity. Most often, identity thieves steal personal financial information, buy things for their own gain, and pay for none of it. Frequently, identity thieves gain access to personal information through business and government databases that are not secure. Dates of birth, full names, bank account details and identification numbers are part of the information sought by identity thieves. Stolen identities can be used to fund other crimes such as illegal immigration, terrorism, or drug crimes. It can be extremely difficult to find and prosecute identity thieves as they are often from different countries than the individuals whose identities they are stealing and they obtain personal details online.

Victims of identity crime can be held responsible for crimes committed using their identity and may have to fight for years to clear their names. In addition to the damage done to individuals, identity crime costs governments large amounts of money every year. Great collaboration between global governments and organizations will likely be needed to combat identity theft in the years to come. Individuals and businesses will also need to protect themselves. <br>How should individuals and organizations work together to protect identities from theft? How will identity thieves adapt their practices as more time and effort is invested in protecting identities? What information will be the most valuable to thieves in the coming years and decades?

Farmers, pet and animal owners, and scientific researchers have many different ways of treating animals in their care. Fewer than 30% of countries have animal welfare laws, and existing laws are not always enforced. Researchers assert that it is important to be able to use animals in research to test drugs and new medical procedures that can help both people and animals. Sometimes endangered animals are kept in captivity at a high cost in order to protect their limited populations. Animal shelters are often filled with feral animals or those that have been abandoned by their owners. Wild animals in many parts of the world come into conflict with human activity.

In the future, how might research impact human understanding and treatment of animals? Are zoos useful educational tools or unethical exhibitions? Are certain animals entitled to more rights than others based on cultural or intelligence differences? How can humans be better stewards in the treatment of animals? Who decides the appropriate treatment of animals and their role in society?

Language is the soul of a culture. The survival of a culture may depend on the language used for rituals and to describe cultural ideas, beliefs, and understandings. What is the impact on culture when its language disappears? By some estimates, of the six thousand languages left on Earth, 90% are expected to disappear or be endangered before the end of this century. In New Zealand, government and community initiatives are trying to revive the language of indigenous people, but even so it is in a precarious state. Many indigenous peoples around the globe don’t have support to prevent their language from disappearing. Will anyone be able to read the rich literature embodied in the disappearing languages in the years to come? What oral traditions will be lost? What responsibilities, if any, do governments, institutions, and communities have towards preserving endangered languages?

Earthquakes, tsunamis, tornadoes, hurricanes, floods, wildfires, and other natural disasters are big news when they occur. Front-page news and internet feeds bring us the details of staggering statistics and images of loss of life and property. Recovery work such as rebuilding homes, infrastructure, and businesses go on even when the news moves on to the next big story. The human factor such as recovery from emotional, mental, and physical stress is a painful and difficult journey for survivors of natural disasters, often taking many years after the disaster strikes. A disaster recovery plan (DRP) often proves inadequate especially since it is often developed only after a disaster. Government agencies, insurance companies, charitable organisations, celebrities, and individual volunteers respond with immediate help, but long-term support can be difficult to sustain. How can relief efforts be best utilised, coordinated, and sustained to assist survivors? How can the people, communities, and countries that are affected by a disaster begin to recover from their losses and cope with their changed lives? How will the impact on psychological and physical health be managed?

The world today is increasingly interdependent with the advent of interconnectedness. The Internet brings individuals living in diverse places together for innovative opportunities in global collaboration. Physical space may no longer define a workplace. Many local and international corporations are able to employ people without them having to step out of their homes or countries. Developed countries outsource jobs to other countries where labour may be cheaper and labour laws less regulated. How might a more global workplace affect local and national economies? Some firms downsize their workforce in favour of automated systems that require less human input. These changes create a pool of workers who, besides being out of work, are often unprepared for other jobs. How might employers develop innovative ways to work globally? Is the growing trend of working globally online benefiting current workplace trends? How might this affect the world economy? What economic or educational changes might better prepare governments, businesses, and workers for a global workplace?

Facebook, Twitter, YouTube, Skype, Second Life, wikis, blogging, tweeting - all of these words have entered our lives in the last few years. The impact of Web 2.0 and the rise of associated social media have changed our lives in many ways that we are only just beginning to understand.

Regimes have fallen because of the use of social media; careers can be jeopardized due to past and present social events posted on social media; people all over the world are able to collaborate in real time to work and to play. Some people think social media has a detrimental effect on people’s social lives; others believe it is a new and exciting way of socializing and developing relationships.

How might social media continue to impact our lives? Who will monitor the truth and accuracy of social media? Will social media lead to increased social isolation or enhanced global collaboration? Is there a need for controls, monitoring, or restrictions on social media? Do the positives outweigh the detrimental effects? Does any government have the right to legislate the use of social media by its citizens?

An increased interest in food and health has occurred around the world. Many questions have been asked on this topic: Where are food products produced? How? Why? Who produces food products? How far have these products traveled? How long have they been stored? How is food tracked from “farm to table”? A huge number of food products are now chemically-enhanced and processed. Foods may be labeled as “natural flavors,” but these do not necessarily come from the original product. Strawberry flavoring, for example, may have started out as a bacterial protein. Are preservatives safe? How might the addition of flavor enhancers, vitamins and minerals, phosphate additives, and sugar and fat substitutes affect our overall health? What are beneficial reasons for using processed foods? What processed foods should we avoid? Genetic engineering is still under study and remains controversial. Nanotechnology represents the latest high technology attempt to infiltrate our food supply. Do these new technologies pose serious new risks for human health?

Propaganda is communication aimed at influencing the attitude of a community toward some cause or position. Selective messages are used to produce an emotional rather than rational response from the audience. Common media for transmitting propaganda messages include news reports, government reports, historical revision, junk science, books, leaflets, movies, radio, television, and posters. Propaganda shares techniques with advertising and public relations.

With growing trends in communication, how will propaganda be spread in the future through digital media? How can wealth of individuals, groups, or countries advance a particular agenda? In a number of regional and global conflicts, including both World Wars, the Korean and Vietnam wars, the Balkan Conflict, and more recently the conflicts in Iraq and Afghanistan, propaganda has more typically referred to political or nationalist uses of these techniques. Examples of these techniques include the following: instilling panic, appealing to prejudice, creating a bandwagon, demonizing the enemy, stating half-truths, and providing a scapegoat. Propaganda usually exists on both sides of a conflict, but is often perceived as negative in nature. What are some positive examples of present-day propaganda? What are some negative examples of present-day propaganda?

Through the use of performance enhancing drugs, personal trainers, speed-enhancing swimsuits, technologies for body and brain, people can enhance their potential in physical, emotional, and cognitive abilities. As time goes on, humans will be offered even more ways to enhance their potential in unprecedented ways: cybernetic body parts, memory-enhancing or erasing drugs, technologically advanced sports equipment, and/or humans/computer interfaces, etc. Will the definition of “human” change? Many ethical issues surround these advances: Should sports people be able to enhance their performances in any way they like? Should parents be able to choose IQ or mood boosters such as drugs or brain implants for their children? What impacts might exist with the disparities between the “haves” and the “have-nots”? How far might the human brain and body be pushed? To what extent can we “perfect” the human body? What “enhancers” do we have presently? What are the dangers, as well as benefits, of powerful new technologies that might radically change the lives of human beings

" Future Problem Solving teaches critical thinking skills, stimulates creativity, encourages development of a vision for the future, and prepares students for leadership roles. "

2022 National Finals (Globe Photography)

Aldous Huxley

Future Problem Solving Australia acknowledges the traditional owners of this land. We recognise their continuing connection to land, waters and community. We pay our respects to Elders past and present.

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Open access
• Published: 31 August 2024

Development and validation of a higher-order thinking skills (HOTS) scale for major students in the interior design discipline for blended learning

• Dandan Li 1 ,
• Xiaolei Fan 2 &
• Lingchao Meng 3  

Scientific Reports volume  14 , Article number:  20287 ( 2024 ) Cite this article

Metrics details

• Environmental social sciences

Assessing and cultivating students’ HOTS are crucial for interior design education in a blended learning environment. However, current research has focused primarily on the impact of blended learning instructional strategies, learning tasks, and activities on the development of HOTS, whereas few studies have specifically addressed the assessment of these skills through dedicated scales in the context of blended learning. This study aimed to develop a comprehensive scale for assessing HOTS in interior design major students within the context of blended learning. Employing a mixed methods design, the research involved in-depth interviews with 10 education stakeholders to gather qualitative data, which informed the development of a 66-item soft skills assessment scale. The scale was administered to a purposive sample of 359 undergraduate students enrolled in an interior design program at a university in China. Exploratory and confirmatory factor analyses were also conducted to evaluate the underlying factor structure of the scale. The findings revealed a robust four-factor model encompassing critical thinking skills, problem-solving skills, teamwork skills, and practical innovation skills. The scale demonstrated high internal consistency (Cronbach's alpha = 0.948–0.966) and satisfactory convergent and discriminant validity. This scale provides a valuable instrument for assessing and cultivating HOTS among interior design major students in blended learning environments. Future research can utilize a scale to examine the factors influencing the development of these skills and inform instructional practices in the field.

Similar content being viewed by others

A meta-analysis of the effects of design thinking on student learning

Blended knowledge sharing model in design professional

Using design thinking for interdisciplinary curriculum design and teaching: a case study in higher education

Introduction.

In the contemporary landscape of the twenty-first century, students face numerous challenges that necessitate the development of competitive skills, with a particular emphasis on the cultivation of HOTS 1 , 2 , 3 , this has become a crucial objective in educational reform. Notably, it is worth noting that the National Education Association (NEA, 2012) has clearly identified critical thinking and problem-solving, communication, collaboration, creativity, and innovation as key competencies that students must possess in the current era, which are considered important components of twenty-first century skills 4 , 5 , 6 , 7 . As learners in the fields of creativity and design, students in the interior design profession also need to possess HOTS to address complex design problems and the evolving demands of the industry 8 , 9 .

Currently, blended learning has become an important instructional model in interior design education 10 , 11 . It serves as a teaching approach that combines traditional face-to-face instruction with online learning, providing students with a more flexible and personalized learning experience 12 , 13 . Indeed, several scholars have recognized the benefits of blended learning in providing students with diverse learning resources, activities, and opportunities for interaction, thereby fostering HOTS 14 , 15 , 16 , 17 . For example, blended learning, as evidenced by studies conducted by Anthony et al. 10 and Castro 11 , has demonstrated its efficacy in enhancing students' HOTS. The integration of online resources, virtual practices, and online discussions in blended learning fosters active student engagement and improves critical thinking, problem solving, and creative thinking skills. Therefore, teachers need to determine appropriate assessment methods and construct corresponding assessment tasks to assess students' expected learning outcomes. This decision requires teachers to have a clear understanding of students' learning progress and the development of various skills, whereas students have knowledge of only their scores and lack awareness of their individual skill development 18 , 19 .

Nevertheless, the precise assessment of students' HOTS in the blended learning milieu poses a formidable challenge. The dearth of empirically validated assessment tools impedes researchers from effectively discerning students' levels of cognitive aptitude and developmental growth within the blended learning realm 20 , 21 , 22 . In addition, from the perspective of actual research topics, current studies on blended learning focus mainly on the "concept, characteristics, mechanisms, models, and supporting technologies of blended learning 23 . " Research on "measuring students' HOTS in blended learning" is relatively limited, with most of the focus being on elementary, middle, and high school students 24 , 25 . Few studies have specifically examined HOTS measurement in the context of university students 26 , 27 , particularly in practical disciplines such as interior design. For example, Bervell et al. 28 suggested that the lack of high-quality assessment scales inevitably impacts the quality of research. Additionally, Schmitt 29 proposed the “Three Cs” principle for measurement, which includes clarity, coherence, and consistency. He highlighted that high-quality assessment scales should possess clear and specific measurement objectives, logically coherent items, and consistent measurement results to ensure the reliability and validity of the data. This reflects the importance of ensuring the alignment of the measurement goals of assessment scales with the research questions and the content of the discipline in the design of assessments.

The development of an assessment scale within the blended learning environment is expected to address the existing gap in measuring and assessing HOTS scores in interior design education. This scale not only facilitates the assessment of students' HOTS but also serves as a guide for curriculum design, instructional interventions, and student support initiatives. Ultimately, the integration of this assessment scale within the blended learning environment has the potential to optimize the development of HOTS among interior design students, empowering them to become adept critical thinkers, creative problem solvers, and competent professionals in the field.

Therefore, this study follows a scientific scale development procedure to develop an assessment scale specifically designed to measure the HOTS of interior design students in blended learning environments. This endeavor aims to provide educators with a reliable instrument for assessing students' progress in cultivating and applying HOTS, thus enabling the implementation of more effective teaching strategies and enhancing the overall quality of interior design education. The research questions are as follows:

What key dimensions should be considered when developing a HOTS assessment scale to accurately capture students' HOTS in an interior design major blended learning environment?

How can an advanced thinking skills assessment scale for blended learning in interior design be developed?

How can the reliability and validity of the HOTS assessment scale be verified and ensured, and is it reliable and effective in the interior design of major blended learning environments?

Key dimensions of HOTS assessment scale in an interior design major blended learning environment

The research results indicate that in the blended learning environment of interior design, this study identified 16 initial codes representing key dimensions for enhancing students' HOTS. These codes were further categorized into 8 main categories and 4 overarching themes: critical thinking, problem-solving, teamwork skills and practical innovation skills. They provide valuable insights for data comprehension and analysis, serving as a comprehensive framework for the HOTS scale. Analyzing category frequency and assessing its significance and universality in a qualitative dataset hold significant analytical value 30 , 31 . High-frequency terms indicate the central position of specific categories in participants' narratives, texts, and other data forms 32 . Through interviews with interior design experts and teachers, all core categories were mentioned more than 20 times, providing compelling evidence of their universality and importance within the field of interior design's HOTS dimensions. As shown in Table 1 .

Themes 1: critical thinking skills

Critical thinking skills constitute a key core category in blended learning environments for interior design and are crucial for cultivating students' HOTS. This discovery emphasizes the importance of critical thinking in interior design learning. This mainly includes the categories of logical reasoning and judgment, doubt and reflection, with a frequency of more than 8, highlighting the importance of critical thinking skills. Therefore, a detailed discussion of each feature is warranted. As shown in Table 2 .

Category 1: logical reasoning and judgment

The research results indicate that in a blended learning environment for interior design, logical reasoning and judgment play a key role in cultivating critical thinking skills. Logical reasoning refers to inferring reasonable conclusions from information through analysis and evaluation 33 . Judgment is based on logic and evidence for decision-making and evaluation. The importance of these concepts lies in their impact on the development and enhancement of students' HOTS. According to the research results, interior design experts and teachers unanimously believe that logical reasoning and judgment are very important. For example, as noted by Interviewee 1, “For students, logical reasoning skills are still very important. Especially in indoor space planning, students use logical reasoning to determine whether the layout of different functional areas is reasonable”. Similarly, Interviewee 2 also stated that “logical reasoning can help students conduct rational analysis of various design element combinations during the conceptual design stage, such as color matching, material selection, and lighting application”.

As emphasized by interviewees 1 and 2, logical reasoning and judgment are among the core competencies of interior designers in practical applications. These abilities enable designers to analyze and evaluate design problems and derive reasonable solutions from them. In the interior design industry, being able to conduct accurate logical reasoning and judgment is one of the key factors for success. Therefore, through targeted training and practice, students can enhance their logical thinking and judgment, thereby better addressing design challenges and providing innovative solutions.

Category 2: skepticism and reflection

Skepticism and reflection play crucial roles in cultivating students' critical thinking skills in a blended learning environment for interior design. Doubt can prompt students to question and explore information and viewpoints, whereas reflection helps students think deeply and evaluate their own thinking process 34 . These abilities are crucial for cultivating students' higher-order thinking skills. According to the research findings, most interior design experts and teachers agree that skepticism and reflection are crucial. For example, as noted by interviewees 3, “Sometimes, when facing learning tasks, students will think about how to better meet the needs of users”. Meanwhile, Interviewee 4 also agreed with this viewpoint. As emphasized by interviewees 3 and 4, skepticism and reflection are among the core competencies of interior designers in practical applications. These abilities enable designers to question existing perspectives and practices and propose innovative design solutions through in-depth thinking and evaluation. Therefore, in the interior design industry, designers with the ability to doubt and reflect are better able to respond to complex design needs and provide clients with unique and valuable design solutions.

Themes 2: problem-solving skills

The research findings indicate that problem-solving skills constitute a key core category in blended learning environments for interior design and are crucial for cultivating students' HOTS. This discovery emphasizes the importance of problem-solving skills in interior design learning. Specifically, categories such as identifying and defining problems, as well as developing and implementing plans, have been studied more than 8 times, highlighting the importance of problem-solving skills. Therefore, it is necessary to discuss each function in detail to better understand and cultivate students' problem-solving skills. As shown in Table 3 .

Category 1: identifying and defining issues

The research findings indicate that in a blended learning environment for interior design, identifying and defining problems play a crucial role in fostering students' problem-solving skills. Identifying and defining problems require students to possess the ability to analyze and evaluate problems, enabling them to accurately determine the essence of the problems and develop effective strategies and approaches to solve them 35 . Interior design experts and teachers widely recognize the importance of identifying and defining problems as core competencies in interior design practice. For example, Interviewee 5 emphasized the importance of identifying and defining problems, stating, "In interior design, identifying and defining problems is the first step in addressing design challenges. Students need to be able to clearly identify the scope, constraints, and objectives of the problems to engage in targeted thinking and decision-making in the subsequent design process." Interviewee 6 also supported this viewpoint. As stressed by Interviewees 5 and 6, identifying and defining problems not only require students to possess critical thinking abilities but also necessitate broad professional knowledge and understanding. Students need to comprehend principles of interior design, spatial planning, human behavior, and other relevant aspects to accurately identify and define problems associated with design tasks.

Category 2: developing and implementing a plan

The research results indicate that in a blended learning environment for interior design, developing and implementing plans plays a crucial role in cultivating students' problem-solving abilities. The development and implementation of a plan refers to students identifying and defining problems, devising specific solutions, and translating them into concrete implementation plans. Specifically, after determining the design strategy, students refine it into specific implementation steps and timelines, including drawing design drawings, organizing PPT reports, and presenting design proposals. For example, Interviewee 6 noted, “Students usually break down design strategies into specific tasks and steps by refining them.” Other interviewees also unanimously support this viewpoint. As emphasized by respondent 6, developing and implementing plans can help students maintain organizational, systematic, and goal-oriented problem-solving skills, thereby enhancing their problem-solving skills.

Themes 3: teamwork skills

The research results indicate that teamwork skills constitute a key core category in blended learning environments for interior design and are crucial for cultivating students' HOTS. This discovery emphasizes the importance of teamwork skills in interior design learning. This mainly includes communication and coordination and division of labor and collaboration, which are mentioned frequently in the interview documents. Therefore, it is necessary to discuss each function in detail to better understand and cultivate students' teamwork skills. As shown in Table 4 .

Category 1: communication and coordination

The research results indicate that communication and collaboration play crucial roles in cultivating students' teamwork abilities in a blended learning environment for interior design. Communication and collaboration refer to the ability of students to effectively share information, understand each other's perspectives, and work together to solve problems 36 . Specifically, team members need to understand each other's resource advantages integrate and share these resources to improve work efficiency and project quality. For example, Interviewee 7 noted, “In interior design, one member may be skilled in spatial planning, while another member may be skilled in color matching. Through communication and collaboration, team members can collectively utilize this expertise to improve work efficiency and project quality.” Other interviewees also unanimously believe that this viewpoint can promote students' teamwork skills, thereby promoting the development of their HOTS. As emphasized by the viewpoints of these interviewees, communication and collaboration enable team members to collectively solve problems and overcome challenges. Through effective communication, team members can exchange opinions and suggestions with each other, provide different solutions, and make joint decisions. Collaboration and cooperation among team members contribute to brainstorming and finding the best solution.

Category 2: division of labor and collaboration

The research results indicate that in the blended learning environment of interior design, the division of labor and collaboration play crucial roles in cultivating students' teamwork ability. The division of labor and collaboration refer to the ability of team members to assign different tasks and roles in a project based on their respective expertise and responsibilities and work together to complete the project 37 . For example, Interviewee 8 noted, “In an internal design project, some students are responsible for space planning, some students are responsible for color matching, and some students are responsible for rendering production.” Other interviewees also support this viewpoint. As emphasized by interviewee 8, the division of labor and collaboration help team members fully utilize their respective expertise and abilities, promote resource integration and complementarity, cultivate a spirit of teamwork, and enable team members to collaborate, support, and trust each other to achieve project goals together.

Themes 4: practical innovation skills

The research results indicate that practical innovation skills constitute a key core category in blended learning environments for interior design and are crucial for cultivating students' HOTS. This discovery emphasizes the importance of practical innovation skills in interior design learning. This mainly includes creative conception and design expression, as well as innovative application of materials and technology, which are often mentioned in interview documents. Therefore, it is necessary to discuss each function in detail to better understand and cultivate students' practical innovation skills. As shown in Table 5 .

Category 1: creative conception and design expression

The research results indicate that in the blended learning environment of interior design, creative ideation and design expression play crucial roles in cultivating students' practical and innovative skills. Creative ideation and design expression refer to the ability of students to break free from traditional thinking frameworks and try different design ideas and methods through creative ideation, which helps stimulate their creativity and cultivate their ability to think independently and solve problems. For example, interviewee 10 noted that "blended learning environments combine online and offline teaching modes, allowing students to acquire knowledge and skills more flexibly. Through learning and practice, students can master various expression tools and techniques, such as hand-drawn sketches, computer-aided design software, model making, etc., thereby more accurately conveying their design concepts." Other interviewees also expressed the importance of this viewpoint, emphasizing the importance of creative ideas and design expression in blended learning environments that cannot be ignored. As emphasized by interviewee 10, creative ideation and design expression in the blended learning environment of interior design can not only enhance students' creative thinking skills and problem-solving abilities but also strengthen their application skills in practical projects through diverse expression tools and techniques. The cultivation of these skills is crucial for students' success in their future careers.

Category 2: innovative application of materials and technology

Research findings indicate that the innovative application of materials and technology plays a crucial role in developing students' practical and creative skills within a blended learning environment for interior design. The innovative application of materials and technology refers to students' exploration and utilization of new materials and advanced technologies, enabling them to overcome the limitations of traditional design thinking and experiments with diverse design methods and approaches. This process not only stimulates their creativity but also significantly enhances their problem-solving skills. Specifically, the innovative application of materials and technology involves students gaining a deep understanding of the properties of new materials and their application methods in design, as well as becoming proficient in various advanced technological tools and equipment, such as 3D printing, virtual reality (VR), and augmented reality (AR). These skills enable students to more accurately realize their design concepts and effectively apply them in real-world projects.

For example, Interviewee 1 stated, "The blended learning environment combines online and offline teaching modes, allowing students to flexibly acquire the latest knowledge on materials and technology and apply these innovations in real projects." Other interviewees also emphasized the importance of this view. Therefore, the importance of the innovative application of materials and technology in a blended learning environment cannot be underestimated. As emphasized by interviewee 1, the innovative application of materials and technologies is crucial in the blended learning environment of interior design. This process not only enables students to flexibly acquire the latest materials and technical knowledge but also enables them to apply these innovations to practice in practical projects, thereby improving their practical abilities and professional ethics.

In summary, through research question 1 research, the dimensions of the HOTS assessment scale in blended learning for interior design include four main aspects: critical thinking skills, problem-solving skills, teamwork skills, and practical innovation skills. Based on the assessment scales developed by previous scholars in various dimensions, the researcher developed a HOTS assessment scale suitable for blended learning environments in interior design and collected feedback from interior design experts through interviews.

Development of the HOTS assessment scale

The above research results indicate that the dimensions of the HOTS scale mainly include critical thinking, problem-solving, teamwork skills and practical innovation skills. The dimensions of a scale represent the abstract characteristics and structure of the concept being measured. Since these dimensions are often abstract and difficult to measure directly, they need to be converted into several concrete indicators that can be directly observed or self-reported 38 . These concrete indicators, known as dimension items, operationalize the abstract dimensions, allowing for the measurement and evaluation of various aspects of the concept. This process transforms the abstract dimensions into specific, measurable components. The following content is based on the results of research question 1 to develop an advanced thinking skills assessment scale for mixed learning in interior design.

Dimension 1: critical thinking skills

The research results indicate that critical thinking skills constitute a key core category in blended learning environments for interior design and are crucial for cultivating students' HOTS. Critical thinking skills refer to the ability to analyze information objectively and make a reasoned judgment 39 . Scholars tend to emphasize this concept as a method of general skepticism, rational thinking, and self-reflection 7 , 40 . For example, Goodsett 26 suggested that it should be based on rational skepticism and careful thought about external matters as well as open self-reflection about internal thoughts and actions. Moreover, the California Critical Thinking Disposition Inventory (CCTDI) is widely used to measure critical thinking skills, including dimensions such as seeking truth, confidence, questioning and courage to seek truth, curiosity and openness, as well as analytical and systematic methods 41 . In addition, maturity means continuous adjustment and improvement of a person's cognitive system and learning activities through continuous awareness, reflection, and self-awareness 42 . Moreover, Nguyen 43 confirmed that critical thinking and cognitive maturity can be achieved through these activities, emphasizing that critical thinking includes cognitive skills such as analysis, synthesis, and evaluation, as well as emotional tendencies such as curiosity and openness.

In addition, in a blended learning environment for interior design, critical thinking skills help students better understand, evaluate, and apply design knowledge and skills, cultivating independent thinking and innovation abilities 44 . If students lack these skills, they may accept superficial information and solutions without sufficient thinking and evaluation, resulting in the overlooking of important details or the selection of inappropriate solutions in the design process. Therefore, for the measurement of critical thinking skills, the focus should be on cognitive skills such as analysis, synthesis, and evaluation, as well as curiosity and open mindedness. The specific items for critical thinking skills are shown in Table 6 .

Dimension 2: problem-solving skills

Problem-solving skills constitute a key core category in blended learning environments for interior design and are crucial for cultivating students' HOTS. Problem-solving skills involve the ability to analyze and solve problems by understanding them, identifying their root causes, and developing appropriate solutions 45 . According to the 5E-based STEM education approach, problem-solving skills encompass the following abilities: problem identification and definition, formulation of problem-solving strategies, problem representation, resource allocation, and monitoring and evaluation of solution effectiveness 7 , 46 . Moreover, D'zurilla and Nezu 47 and Tan 48 indicated that attitudes, beliefs, and knowledge skills during problem solving, as well as the quality of proposed solutions and observable outcomes, are demonstrated. In addition, D'Zurilla and Nezu devised the Social Problem-Solving Inventory (SPSI), which comprises seven subscales: cognitive response, emotional response, behavioral response, problem identification, generation of alternative solutions, decision-making, and solution implementation. Based on these research results, the problem-solving skills dimension questions designed in this study are shown in Table 7 .

Dimension 3: teamwork skills

The research results indicate that teamwork skills constitute a key core category in blended learning environments for interior design and are crucial for cultivating students' HOTS. Teamwork skills refer to the ability to effectively collaborate, coordinate, and communicate with others in a team environment 49 . For example, the Teamwork Skills Assessment Tool (TWKSAT) developed by Stevens and Campion 50 identifies five core dimensions of teamwork: conflict management; collaborative problem-solving; communication; goal setting; performance management; decision-making; and task coordination. The design of this tool highlights the essential skills in teamwork and provides a structured approach for evaluating these skills. In addition, he indicated that successful teams need to have a range of skills for problem solving, including situational control, conflict management, decision-making and coordination, monitoring and feedback, and an open mindset. These skills help team members effectively address complex challenges and demonstrate the team’s collaboration and flexibility. Therefore, the assessment of learners' teamwork skills needs to cover the above aspects. As shown in Table 8 .

Dimension 4: practice innovative skills

The research results indicate that practical innovation skills constitute a key core category in blended learning environments for interior design, which is crucial for cultivating students' HOTS. The practice of innovative skills encompasses the utilization of creative cognitive processes and problem-solving strategies to facilitate the generation of original ideas, solutions, and approaches 51 . This practice places significant emphasis on two critical aspects: creative conception and design expression, as well as the innovative application of materials and technology. Tang et al. 52 indicated that creative conception and design expression involve the generation and articulation of imaginative and inventive ideas within a given context. With the introduction of concepts such as 21st-century learning skills, the "5C" competency framework, and core student competencies, blended learning has emerged as the goal and direction of educational reform. It aims to promote the development of students' HOTS, equipping them with the essential qualities and key abilities needed for lifelong development and societal advancement. Blended learning not only emphasizes the mastery of core learning content but also requires students to develop critical thinking, complex problem-solving, creative thinking, and practical innovation skills. To adapt to the changes and developments in the blended learning environment, this study designed 13 preliminary test items based on 21st-century learning skills, the "5C" competency framework, core student competencies, and the TTCT assessment scale developed by Torrance 53 . These items aim to assess students' practice of innovative skills within a blended learning environment, as shown in Table 9 .

The researchers' results indicate that the consensus among the interviewed expert participants is that the structural integrity of the scale is satisfactory and does not require modification. However, certain measurement items have been identified as problematic and require revision. The primary recommendations are as follows: Within the domain of problem-solving skills, the item "I usually conduct classroom and online learning with questions and clear goals" was deemed biased because of its emphasis on the "online" environment. Consequently, the evaluation panel advised splitting this item into two separate components: (1) "I am adept at frequently adjusting and reversing a negative team atmosphere" and (2) "I consistently engage in praising and encouraging others, fostering harmonious relationships. “The assessment process requires revisions and adjustments to specific projects, forming a pilot test scale consisting of 66 observable results from the original 65 items. In addition, there were other suggestions about linguistic formulation and phraseology, which are not expounded upon herein.

Verify the effectiveness of the HOTS assessment scale

The research results indicate that there are significant differences in the average scores of the four dimensions of the HOTS, including critical thinking skills (A1–A24 items), problem-solving skills (B1–B13 items), teamwork skills (C1–C16 items), and practical innovation skills (D1–D13 items). Moreover, this also suggests that each item has discriminative power. Specifically, this will be explained through the following aspects.

Project analysis based on the CR value

The critical ratio (CR) method, which uses the CR value (decision value) to remove measurement items with poor discrimination, is the most used method in project analysis. The specific process involves the use of the CR value (critical value) to identify and remove such items. First, the modified pilot test scale data are aggregated and sorted. Individuals representing the top and bottom 27% of the distribution were subsequently selected, constituting 66 respondents in each group. The high-score group comprises individuals with a total score of 127 or above (including 127), whereas the low-score group comprises individuals with a total score of 99 or below (including 99). Finally, an independent sample t test was conducted to determine the significant differences in the mean scores for each item between the high-score and low-score groups. The statistical results are presented in Table 10 .

The above table shows that independent sample t tests were conducted for all the items; their t values were greater than 3, and their p values were less than 0.001, indicating that the difference between the highest and lowest 27% of the samples was significant and that each item had discriminative power.

In summary, based on previous research and relevant theories, the HOTS scale for interior design was revised. This revision process involved interviews with interior design experts, teachers, and students, followed by item examination and homogeneity testing via the critical ratio (CR) method. The results revealed significant correlations ( p  < 0.01) between all the items and the total score, with correlation coefficients (R) above 0.4. Therefore, the scale exhibits good accuracy and internal consistency in capturing measured HOTS. These findings provide a reliable foundation for further research and practical applications.

Pilot study exploratory factor analysis

This study used SPSS (version 28) to conduct the KMO and Bartlett tests on the scale. The total HOTS test scale as well as the KMO and Bartlett sphericities were first calculated for the four subscales to ensure that the sample data were suitable for factor analysis 7 . The overall KMO value is 0.946, indicating that the data are highly suitable for factor analysis. Additionally, Bartlett's test of sphericity was significant, further supporting the appropriateness of conducting factor analysis ( p  < 0.05). All the values are above 0.7, indicating that the data for these subscales are also suitable for factor analysis. According to Javadi et al. 54 , these results suggest the presence of shared factors among the items within the subscales, as shown in Table 11 .

For each subscale, exploratory factor analysis was conducted to extract factors with eigenvalues greater than 1 while eliminating items with communalities less than 0.30, loadings less than 0.50, and items that cross multiple (more than one) common factors 55 , 56 . Additionally, items that were inconsistent with the assumed structure of the measure were identified and eliminated to ensure the best structural validity. These principles were applied to the factor analysis of each subscale, ensuring that the extracted factor structure and observed items are consistent with the hypothesized measurement structure and analysis results, as shown in the table 55 , 58 . In the exploratory factor analysis (EFA), the latent variables were effectively interpreted and demonstrated a significant response, with cumulative explained variances of the common factors exceeding 60%. This finding confirms the alignment between the scale structure, comprising the remaining items, and the initial theoretical framework proposed in this study. Additionally, the items were systematically reorganized to construct the final questionnaire. Consequently, items A1 to A24 were associated with the critical thinking skills dimension, items B25 to B37 were linked to problem-solving skills, items C38 to C53 were indicative of teamwork skills, and items D54 to D66 were reflective of practical innovation skills. As shown in Table 12 below.

In addition, the criterion for extracting principal components in factor analysis is typically based on eigenvalues, with values greater than 1 indicating greater explanatory power than individual variables. The variance contribution ratio reflects the proportion of variance explained by each principal component relative to the total variance and signifies the ability of the principal component to capture comprehensive information. The cumulative variance contribution ratio measures the accumulated proportion of variance explained by the selected principal components, aiding in determining the optimal number of components to retain while minimizing information loss. The above table shows that four principal components can be extracted from the data, and their cumulative variance contribution rate reaches 59.748%.

However, from the scree plot (as shown in Fig.  1 ), the slope flattens starting from the fifth factor, indicating that no distinct factors can be extracted beyond that point. Therefore, retaining four factors seems more appropriate. The factor loading matrix is the core of factor analysis, and the values in the matrix represent the factor loading of each item on the common factors. Larger values indicate a stronger correlation between the item variable and the common factor. For ease of analysis, this study used the maximum variance method to rotate the initial factor loading matrix, redistributing the relationships between the factors and original variables and making the correlation coefficients range from 0 to 1, which facilitates interpretation. In this study, factor loadings with absolute values less than 0.4 were filtered out. According to the analysis results, the items of the HOTS assessment scale can be divided into four dimensions, which is consistent with theoretical expectations.

Gravel plot of factors.

Through the pretest of the scale and selection of measurement items, 66 measurement items were ultimately determined. On this basis, a formal scale for assessing HOTS in a blended learning environment was developed, and the reliability and validity of the scale were tested to ultimately confirm its usability.

Confirmatory factor analysis of final testing

Final test employed that AMOS (version 26.0), a confirmatory factor analysis (CFA) was conducted on the retested sample data to validate the stability of the HOTS structural model obtained through exploratory factor analysis. This analysis aimed to assess the fit between the measurement results and the actual data, confirming the robustness of the derived HOTS structure and its alignment with the empirical data. The relevant model was constructed based on the factor structure of each component obtained through EFA and the observed variables, as shown in the diagram. The model fit indices are presented in Fig.  2 (among them, A represents critical thinking skills, B represents problem-solving skills, C represents teamwork skills, and D represents practical innovation skills). The models strongly support the "4-dimensional" structure of the HOTS, which includes four first-order factors: critical thinking skills, problem-solving skills, teamwork skills, and practical innovation skills. Critical thinking skills play a pivotal role in the blended learning environment of interior design, connecting problem-solving skills, teamwork skills, and innovative practices. These four dimensions form the assessment structure of HOTS, with critical thinking skills serving as the core element, inspiring individuals to assess problems and propose innovative solutions. By providing appropriate learning resources, diverse learning activities, and learning tasks, as well as designing items for assessment scales, it is possible to delve into the measurement and development of HOTS in the field of interior design, providing guidance for educational and organizational practices. This comprehensive approach to learning and assessment helps cultivate students' HOTS and lays a solid foundation for their comprehensive abilities in the field of interior design. Thus, the CFA structural models provide strong support for the initial hypothesis of the proposed HOTS assessment structure in this study. As shown in Fig.  2 .

Confirmatory factor analysis based on 4 dimensions. *A represents the dimension of critical thinking. B represents the dimension of problem-solving skills. C represents the dimension of teamwork skills. D represents the dimension of practical innovation skills.

Additionally, χ2. The fitting values of RMSEA and SRMR are both below the threshold, whereas the fitting values of the other indicators are all above the threshold, indicating that the model fits well. As shown in Table 13 .

Reliability and validity analysis

The reliability and validity of the scale need to be assessed after the model fit has been determined through validation factor analysis 57 . Based on the findings of Marsh et al. 57 , the following conclusions can be drawn. In terms of hierarchical and correlational model fit, the standardized factor loadings of each item range from 0.700 to 0.802, all of which are greater than or equal to 0.7. This indicates a strong correspondence between the observed items and each latent variable. Furthermore, the Cronbach's α coefficients, which are used to assess the internal consistency or reliability of the scale, ranged from 0.948 to 0.966 for each dimension, indicating a high level of data reliability and internal consistency. The composite reliabilities ranged from 0.948 to 0.967, exceeding the threshold of 0.6 and demonstrating a substantial level of consistency (as shown in Table 14 ).

Additionally, the diagonal bold font represents the square root of the AVE for each dimension. All the dimensions have average variance extracted (AVE) values ranging from 0.551 to 0.589, all of which are greater than 0.5, indicating that the latent variables have strong explanatory power for their corresponding items. These results suggest that the scale structure constructed in this study is reliable and effective. Furthermore, according to the results presented in Table 15 , the square roots of the AVE values for each dimension are greater than the absolute values of the correlations with other dimensions, indicating discriminant validity of the data. Therefore, these four subscales demonstrate good convergent and discriminant validity, indicating that they are both interrelated and independent. This implies that they can effectively capture the content required to complete the HOTS test scale.

Discussion and conclusion

The assessment scale for HOTS in interior design blended learning encompasses four dimensions: critical thinking skills, problem-solving skills, teamwork skills, and practical innovation skills. The selection of these dimensions is based on the characteristics and requirements of the interior design discipline, which aims to comprehensively evaluate students' HOTS demonstrated in blended learning environments to better cultivate their ability to successfully address complex design projects in practice. Notably, multiple studies have shown that HOTSs include critical thinking, problem-solving skills, creative thinking, and decision-making skills, which are considered crucial in various fields, such as education, business, and engineering 20 , 59 , 60 , 61 . Compared with prior studies, these dimensions largely mirror previous research outcomes, with notable distinctions in the emphasis on teamwork skills and practical innovation skills 62 , 63 . Teamwork skills underscore the critical importance of collaboration in contemporary design endeavors, particularly within the realm of interior design 64 . Effective communication and coordination among team members are imperative for achieving collective design objectives.

Moreover, practical innovation skills aim to increase students' capacity for creatively applying theoretical knowledge in practical design settings. Innovation serves as a key driver of advancement in interior design, necessitating students to possess innovative acumen and adaptability to evolving design trends for industry success. Evaluating practical innovation skills aims to motivate students toward innovative thinking, exploration of novel concepts, and development of unique design solutions, which is consistent with the dynamic and evolving nature of the interior design sector. Prior research suggests a close interplay between critical thinking, problem-solving abilities, teamwork competencies, and creative thinking, with teamwork skills acting as a regulatory factor for critical and creative thought processes 7 , 65 . This interconnected nature of HOTS provides theoretical support for the construction and validation of a holistic assessment framework for HOTS.

After the examination by interior design expert members, one item needed to be split into two items. The results of the CR (construct validity) analysis of the scale items indicate that independent sample t tests were subsequently conducted on all the items. The t values were greater than 3, with p values less than 0.001, indicating significant differences between the top and bottom 27% of the samples and demonstrating the discriminant validity of each item. This discovery highlights the diversity and effectiveness of the scale's internal items, revealing the discriminatory power of the scale in assessing the study subjects. The high t values and significant p values reflect the substantiality of the internal items in distinguishing between different sample groups, further confirming the efficacy of these items in evaluating the target characteristics. These results provide a robust basis for further refinement and optimization of the scale and offer guidance for future research, emphasizing the importance of scale design in research and providing strong support for data interpretation and analysis.

This process involves evaluating measurement scales through EFA, and it was found that the explanatory variance of each subscale reached 59.748%, and the CR, AVE, Cronbach's alpha, and Pearson correlation coefficient values of the total scale and subscales were in a better state, which strongly demonstrates the structure, discrimination, and convergence effectiveness of the scale 57 .

The scale structure and items of this study are reliable and effective, which means that students in the field of interior design can use them to test their HOTS level and assess their qualities and abilities. In addition, scholars can use this scale to explore the relationships between students' HOTS and external factors, personal personalities, etc., to determine different methods and strategies for developing and improving HOTS.

Limitations and future research

The developed mixed learning HOTS assessment scale for interior design also has certain limitations that need to be addressed in future research. The first issue is that, owing to the requirement of practical innovation skills, students need to have certain practical experience and innovative abilities. First-grade students usually have not yet had sufficient opportunities for learning and practical experience, so it may not be possible to evaluate their abilities effectively in this dimension. Therefore, when this scale is used for assessment, it is necessary to consider students' grade level and learning experience to ensure the applicability and accuracy of the assessment tool. For first-grade students, it may be necessary to use other assessment tools that are suitable for their developmental stage and learning experience to evaluate other aspects of their HOTS 7 . Future research should focus on expanding the scope of this dimension to ensure greater applicability.

The second issue is that the sample comes from ordinary private undergraduate universities in central China and does not come from national public universities or key universities. Therefore, there may be regional characteristics in the obtained data. These findings suggest that the improved model should be validated with a wider range of regional origins, a more comprehensive school hierarchy, and a larger sample size. The thirdly issue is the findings of this study are derived from self-reported data collected from participants through surveys. However, it is important to note that the literature suggests caution in heavily relying on such self-reported data, as perception does not always equate to actions 66 . In addition, future research can draw on this scale to evaluate the HOTS of interior design students, explore the factors that affect their development, determine their training and improvement paths, and cultivate skilled talent for the twenty-first century.

This study adopts a mixed method research approach, combining qualitative and quantitative methods to achieve a comprehensive understanding of the phenomenon 67 . By integrating qualitative and quantitative research methods, mixed methods research provides a comprehensive and detailed exploration of research questions, using multiple data sources and analytical methods to obtain accurate and meaningful answers 68 . To increase the quality of the research, the entire study followed the guidelines for scale development procedures outlined by Professor Li after the data were obtained. As shown in Fig.  3

Scale development program.

Basis of theory

This study is guided by educational objectives such as 21st-century learning skills, the "5C" competency framework, and students' core abilities 4 . The construction process of the scale is based on theoretical foundations, including Bloom's taxonomy. Drawing from existing research, such as the CCTDI 41 , SPSI 69 , and TWKSAT scales, the dimensions and preliminary items of the scale were developed. Additionally, to enhance the validity and reliability of the scale, dimensions related to HOTS in interior design were obtained through semi-structured interviews, and the preliminary project adapted or directly cited existing research results. The preliminary items were primarily adapted or directly referenced from existing research findings. Based on existing research, such as the CCTDI, SPSI, TWKSAT, and twenty-first century skills frameworks, this study takes "critical thinking skills, problem-solving skills, teamwork skills, and practical innovative skills" as the four basic dimensions of the scale.

Participants and procedures

This study is based on previous research and develops a HOTS assessment scale to measure the thinking levels of interior design students in blended learning. By investigating the challenges and opportunities students encounter in blended learning environments and exploring the complexity and diversity of their HOTS, this study aims to obtain comprehensive insights. For research question 1, via the purposive sampling method, 10 interior design experts are selected to investigate the dimensions and evaluation indicators of HOTS in blended learning of interior design. The researcher employed a semi structured interview method, and a random sampling technique was used to select 10 senior experts and teachers in the field of interior design, holding the rank of associate professor or above. This included 5 males and 5 females. As shown in Table 16 .

For research question 2 and 3, the research was conducted at an undergraduate university in China, in the field of interior design and within a blended learning environment. In addition, a statement confirms that all experimental plans have been approved by the authorized committee of Zhengzhou University of Finance and Economics. In the process of practice, the methods used were all in accordance with relevant guidelines and regulations, and informed consent was obtained from all participants. The Interior Design Blended Learning HOTS assessment scale was developed based on sample data from 350 students who underwent one pre-test and retest. The participants in the study consisted of second-, third-, and fourth-grade students who had participated in at least one blended learning course. The sample sizes were 115, 118, and 117 for the respective grade levels, totaling 350 individuals. Among the participants, there were 218 male students and 132 female students, all of whom were within the age range of 19–22 years. Through purposeful sampling, this study ensured the involvement of relevant participants and focused on a specific university environment with diverse demographic characteristics and rich educational resources.

This approach enhances the reliability and generalizability of the research and contributes to a deeper understanding of the research question (as shown in Table 17 ).

Instruments

The tools used in this study include semi structured interview guidelines and the HOTS assessment scale developed by the researchers. For research question 1, the semi structured interview guidelines were reviewed by interior design experts to ensure the accuracy and appropriateness of their content and questions. In addition, for research question 2 and 3, the HOTS assessment scale developed by the researchers will be checked via the consistency ratio (CR) method to assess the consistency and reliability of the scale items and validate their effectiveness.

Data analysis

For research question 1, the researcher will utilize the NVivo version 14 software tool to conduct thematic analysis on the data obtained through semi structured interviews. Thematic analysis is a commonly used qualitative research method that aims to identify and categorize themes, concepts, and perspectives that emerge within a dataset 70 . By employing NVivo software, researchers can effectively organize and manage large amounts of textual data and extract themes and patterns from them.

For research question 2, the critical ratio (CR) method was employed to conduct item analysis and homogeneity testing on the items of the pilot test questionnaire. The CR method allows for the assessment of each item's contribution to the total score and the evaluation of the interrelationships among the items within the questionnaire. These analytical techniques served to facilitate the evaluation and validation of the scale's reliability and validity.

For research question 3, this study used SPSS (version 26), in which confirmatory factor analysis (CFA) was conducted on the confirmatory sample data via maximum likelihood estimation. The purpose of this analysis was to verify whether the hypothesized factor structure model of the questionnaire aligned with the actual survey data. Finally, several indices, including composite reliability (CR), average variance extracted (CR), average variance extracted (AVE), Cronbach's alpha coefficient, and the Pearson correlation coefficient, were computed to assess the reliability and validity of the developed scale and assess its reliability and validity.

In addition, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) are commonly utilized techniques in questionnaire development and adaptation research 31 , 70 . The statistical software packages SPSS and AMOS are frequently employed for implementing these analytical techniques 71 , 72 , 73 . CFA is a data-driven approach to factor generation that does not require a predetermined number of factors or specific relationships with observed variables. Its focus lies in the numerical characteristics of the data. Therefore, prior to conducting CFA, survey questionnaires are typically constructed through EFA to reveal the underlying structure and relationships between observed variables and the latent structure.

In contrast, CFA tests the hypothesized model structure under specific theoretical assumptions or structural hypotheses, including the interrelationships among factors and the known number of factors. Its purpose is to validate the hypothesized model structure. Thus, the initial validity of the questionnaire structure, established through EFA, necessitates further confirmation through CFA 57 , 70 . Additionally, a sample size of at least 200 is recommended for conducting the validation factor analysis. In this study, confirmatory factor analysis was performed on a sample size of 317.

Data availability

All data generated or analyzed during this study are included in this published article. All the experimental protocols were approved by the Zhengzhou College of Finance and Economics licensing committee.

Hariadi, B. et al. Higher order thinking skills based learning outcomes improvement with blended web mobile learning Model. Int. J. Instr. 15 (2), 565–578 (2022).

Google Scholar  

Sagala, P. N. & Andriani, A. Development of higher-order thinking skills (HOTS) questions of probability theory subject based on bloom’s taxonomy. J. Phys. Conf. Ser. https://doi.org/10.1088/1742-6596/1188/1/012025 (2019).

Article   Google Scholar  

Yudha, R. P. Higher order thinking skills (HOTS) test instrument: Validity and reliability analysis with the rasch model. Eduma Math. Educ. Learn. Teach. https://doi.org/10.24235/eduma.v12i1.9468 (2023).

Leach, S. M., Immekus, J. C., French, B. F. & Hand, B. The factorial validity of the Cornell critical thinking tests: A multi-analytic approach. Think. Skills Creat. https://doi.org/10.1016/j.tsc.2020.100676 (2020).

Noroozi, O., Dehghanzadeh, H. & Talaee, E. A systematic review on the impacts of game-based learning on argumentation skills. Entertain. Comput. https://doi.org/10.1016/j.entcom.2020.100369 (2020).

Supena, I., Darmuki, A. & Hariyadi, A. The influence of 4C (constructive, critical, creativity, collaborative) learning model on students’ learning outcomes. Int. J. Instr. 14 (3), 873–892. https://doi.org/10.29333/iji.2021.14351a (2021).

Zhou, Y., Gan, L., Chen, J., Wijaya, T. T. & Li, Y. Development and validation of a higher-order thinking skills assessment scale for pre-service teachers. Think. Skills Creat. https://doi.org/10.1016/j.tsc.2023.101272 (2023).

Musfy, K., Sosa, M. & Ahmad, L. Interior design teaching methodology during the global COVID-19 pandemic. Interiority 3 (2), 163–184. https://doi.org/10.7454/in.v3i2.100 (2020).

Yong, S. D., Kusumarini, Y. & Tedjokoesoemo, P. E. D. Interior design students’ perception for AutoCAD SketchUp and Rhinoceros software usability. IOP Conf. Ser. Earth Environ. Sci. https://doi.org/10.1088/1755-1315/490/1/012015 (2020).

Anthony, B. et al. Blended learning adoption and implementation in higher education: A theoretical and systematic review. Technol. Knowl. Learn. 27 (2), 531–578. https://doi.org/10.1007/s10758-020-09477-z (2020).

Castro, R. Blended learning in higher education: Trends and capabilities. Edu. Inf. Technol. 24 (4), 2523–2546. https://doi.org/10.1007/s10639-019-09886-3 (2019).

Alismaiel, O. Develop a new model to measure the blended learning environments through students’ cognitive presence and critical thinking skills. Int. J. Emerg. Technol. Learn. 17 (12), 150–169. https://doi.org/10.3991/ijet.v17i12.30141 (2022).

Gao, Y. Blended teaching strategies for art design major courses in colleges. Int. J. Emerg. Technol. Learn. https://doi.org/10.3991/ijet.v15i24.19033 (2020).

Banihashem, S. K., Kerman, N. T., Noroozi, O., Moon, J. & Drachsler, H. Feedback sources in essay writing: peer-generated or AI-generated feedback?. Int. J. Edu. Technol. Higher Edu. 21 (1), 23 (2024).

Ji, J. A Design on Blended Learning to Improve College English Students’ Higher-Order Thinking Skills. https://doi.org/10.18282/l-e.v10i4.2553 (2021).

Noroozi, O. The role of students’ epistemic beliefs for their argumentation performance in higher education. Innov. Edu. Teach. Int. 60 (4), 501–512 (2023).

Valero Haro, A., Noroozi, O., Biemans, H. & Mulder, M. First- and second-order scaffolding of argumentation competence and domain-specific knowledge acquisition: A systematic review. Technol. Pedag. Edu. 28 (3), 329–345. https://doi.org/10.1080/1475939x.2019.1612772 (2019).

Narasuman, S. & Wilson, D. M. Investigating teachers’ implementation and strategies on higher order thinking skills in school based assessment instruments. Asian J. Univ. Edu. https://doi.org/10.24191/ajue.v16i1.8991 (2020).

Valero Haro, A., Noroozi, O., Biemans, H. & Mulder, M. Argumentation competence: Students’ argumentation knowledge, behavior and attitude and their relationships with domain-specific knowledge acquisition. J. Constr. Psychol. 35 (1), 123–145 (2022).

Johansson, E. The Assessment of Higher-order Thinking Skills in Online EFL Courses: A Quantitative Content Analysis (2020).

Noroozi, O., Kirschner, P. A., Biemans, H. J. A. & Mulder, M. Promoting argumentation competence: Extending from first- to second-order scaffolding through adaptive fading. Educ. Psychol. Rev. 30 (1), 153–176. https://doi.org/10.1007/s10648-017-9400-z (2017).

Noroozi, O., Weinberger, A., Biemans, H. J. A., Mulder, M. & Chizari, M. Facilitating argumentative knowledge construction through a transactive discussion script in CSCL. Comput. Educ. 61 , 59–76. https://doi.org/10.1016/j.compedu.2012.08.013 (2013).

Noroozi, O., Weinberger, A., Biemans, H. J. A., Mulder, M. & Chizari, M. Argumentation-based computer supported collaborative learning (ABCSCL): A synthesis of 15 years of research. Educ. Res. Rev. 7 (2), 79–106. https://doi.org/10.1016/j.edurev.2011.11.006 (2012).

Setiawan, Baiq Niswatul Khair, Ratnadi Ratnadi, Mansur Hakim, & Istiningsih, S. Developing HOTS-Based Assessment Instrument for Primary Schools (2019).

Suparman, S., Juandi, D., & Tamur, M. Does Problem-Based Learning Enhance Students’ Higher Order Thinking Skills in Mathematics Learning? A Systematic Review and Meta-Analysis 2021 4th International Conference on Big Data and Education (2021).

Goodsett, M. Best practices for teaching and assessing critical thinking in information literacy online learning objects. J. Acad. Lib. https://doi.org/10.1016/j.acalib.2020.102163 (2020).

Putra, I. N. A. J., Budiarta, L. G. R., & Adnyayanti, N. L. P. E. Developing Authentic Assessment Rubric Based on HOTS Learning Activities for EFL Teachers. In Proceedings of the 2nd International Conference on Languages and Arts across Cultures (ICLAAC 2022) (pp. 155–164). https://doi.org/10.2991/978-2-494069-29-9_17 .

Bervell, B., Umar, I. N., Kumar, J. A., Asante Somuah, B. & Arkorful, V. Blended learning acceptance scale (BLAS) in distance higher education: Toward an initial development and validation. SAGE Open https://doi.org/10.1177/21582440211040073 (2021).

Byrne, D. A worked example of Braun and Clarke’s approach to reflexive thematic analysis. Qual. Quant. 56 (3), 1391–1412 (2022).

Xu, W. & Zammit, K. Applying thematic analysis to education: A hybrid approach to interpreting data in practitioner research. Int. J. Qual. Methods 19 , 1609406920918810 (2020).

Braun, V. & Clarke, V. Conceptual and design thinking for thematic analysis. Qual. Psychol. 9 (1), 3 (2022).

Creswell, A., Shanahan, M., & Higgins, I. Selection-inference: Exploiting large language models for interpretable logical reasoning. arXiv:2205.09712 (2022).

Baron, J. Thinking and Deciding 155–156 (Cambridge University Press, 2023).

Book   Google Scholar  

Silver, N., Kaplan, M., LaVaque-Manty, D. & Meizlish, D. Using Reflection and Metacognition to Improve Student Learning: Across the Disciplines, Across the Academy (Taylor & Francis, 2023).

Oksuz, K., Cam, B. C., Kalkan, S. & Akbas, E. Imbalance problems in object detection: A review. IEEE Trans. Pattern Anal. Mach. Intell. 43 (10), 3388–3415 (2020).

Saputra, M. D., Joyoatmojo, S., Wardani, D. K. & Sangka, K. B. Developing critical-thinking skills through the collaboration of jigsaw model with problem-based learning model. Int. J. Instr. 12 (1), 1077–1094 (2019).

Imam, H. & Zaheer, M. K. Shared leadership and project success: The roles of knowledge sharing, cohesion and trust in the team. Int. J. Project Manag. 39 (5), 463–473 (2021).

DeCastellarnau, A. A classification of response scale characteristics that affect data quality: A literature review. Qual. Quant. 52 (4), 1523–1559 (2018).

Article   PubMed   Google Scholar  

Haber, J. Critical Thinking 145–146 (MIT Press, 2020).

Hanscomb, S. Critical Thinking: The Basics 180–181 (Routledge, 2023).

Sulaiman, W. S. W., Rahman, W. R. A. & Dzulkifli, M. A. Examining the construct validity of the adapted California critical thinking dispositions (CCTDI) among university students in Malaysia. Proc. Social Behav. Sci. 7 , 282–288 (2010).

Jaakkola, N. et al. Becoming self-aware—How do self-awareness and transformative learning fit in the sustainability competency discourse?. Front. Educ. https://doi.org/10.3389/feduc.2022.855583 (2022).

Nguyen, T. T. B. Critical thinking: What it means in a Vietnamese tertiary EFL context. English For. Language Int. J. 2 (3), 4–23 (2022).

Henriksen, D., Gretter, S. & Richardson, C. Design thinking and the practicing teacher: Addressing problems of practice in teacher education. Teach. Educ. 31 (2), 209–229 (2020).

Okes, D. Root cause analysis: The core of problem solving and corrective action 179–180 (Quality Press, 2019).

Eroğlu, S. & Bektaş, O. The effect of 5E-based STEM education on academic achievement, scientific creativity, and views on the nature of science. Learn. Individual Differ. 98 , 102181 (2022).

Dzurilla, T. J. & Nezu, A. M. Development and preliminary evaluation of the social problem-solving inventory. Psychol. Assess. J. Consult. Clin. Psychol. 2 (2), 156 (1990).

Tan, O.-S. Problem-based learning innovation: Using problems to power learning in the 21st century. Gale Cengage Learning (2021).

Driskell, J. E., Salas, E. & Driskell, T. Foundations of teamwork and collaboration. Am. Psychol. 73 (4), 334 (2018).

Lower, L. M., Newman, T. J. & Anderson-Butcher, D. Validity and reliability of the teamwork scale for youth. Res. Social Work Pract. 27 (6), 716–725 (2017).

Landa, R. Advertising by design: generating and designing creative ideas across media (Wiley, 2021).

Tang, T., Vezzani, V. & Eriksson, V. Developing critical thinking, collective creativity skills and problem solving through playful design jams. Think. Skills Creat. 37 , 100696 (2020).

Torrance, E. P. Torrance tests of creative thinking. Educational and psychological measurement (1966).

Javadi, M. H., Khoshnami, M. S., Noruzi, S. & Rahmani, R. Health anxiety and social health among health care workers and health volunteers exposed to coronavirus disease in Iran: A structural equation modeling. J. Affect. Disord. Rep. https://doi.org/10.1016/j.jadr.2022.100321 (2022).

Article   PubMed   PubMed Central   Google Scholar  

Hu, L. & Bentler, P. M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 6 (1), 1–55. https://doi.org/10.1080/10705519909540118 (1999).

Matsunaga, M. Item parceling in structural equation modeling: A primer. Commun. Methods Measures 2 (4), 260–293. https://doi.org/10.1080/19312450802458935 (2008).

Marsh, H. W., Morin, A. J., Parker, P. D. & Kaur, G. Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Ann. Rev. Clin. Psychol. 10 (1), 85–110 (2014).

Song, Y., Lee, Y. & Lee, J. Mediating effects of self-directed learning on the relationship between critical thinking and problem-solving in student nurses attending online classes: A cross-sectional descriptive study. Nurse Educ. Today https://doi.org/10.1016/j.nedt.2021.105227 (2022).

Chu, S. K. W., Reynolds, R. B., Tavares, N. J., Notari, M., & Lee, C. W. Y. 21st century skills development through inquiry-based learning from theory to practice . Springer (2021).

Eliyasni, R., Kenedi, A. K. & Sayer, I. M. Blended learning and project based learning: the method to improve students’ higher order thinking skill (HOTS). Jurnal Iqra’: Kajian Ilmu Pendidikan 4 (2), 231–248 (2019).

Yusuf, P. & Istiyono,. Blended learning: Its effect towards higher order thinking skills (HOTS). J. Phys. Conf. Ser. https://doi.org/10.1088/1742-6596/1832/1/012039 (2021).

Byron, K., Keem, S., Darden, T., Shalley, C. E. & Zhou, J. Building blocks of idea generation and implementation in teams: A meta-analysis of team design and team creativity and innovation. Personn. Psychol. 76 (1), 249–278 (2023).

Walid, A., Sajidan, S., Ramli, M. & Kusumah, R. G. T. Construction of the assessment concept to measure students’ high order thinking skills. J. Edu. Gift. Young Sci. 7 (2), 237–251 (2019).

Alawad, A. Evaluating online learning practice in the interior design studio. Int. J. Art Des. Edu. 40 (3), 526–542. https://doi.org/10.1111/jade.12365 (2021).

Awuor, N. O., Weng, C. & Militar, R. Teamwork competency and satisfaction in online group project-based engineering course: The cross-level moderating effect of collective efficacy and flipped instruction. Comput. Educ. 176 , 104357 (2022).

Noroozi, O., Alqassab, M., Taghizadeh Kerman, N., Banihashem, S. K. & Panadero, E. Does perception mean learning? Insights from an online peer feedback setting. Assess. Eval. Higher Edu. https://doi.org/10.1080/02602938.2024.2345669 (2024).

Creswell, J. W. A concise introduction to mixed methods research. SAGE publications124–125 (2021) .

Tashakkori, A., Johnson, R. B., & Teddlie, C. Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. Sage Publications 180–181(2020).

Jiang, X., Lyons, M. D. & Huebner, E. S. An examination of the reciprocal relations between life satisfaction and social problem solving in early adolescents. J. Adolescence 53 (1), 141–151. https://doi.org/10.1016/j.adolescence.2016.09.004 (2016).

Orcan, F. Exploratory and confirmatory factor analysis: Which one to use first. Egitimde ve Psikolojide Olçme ve Degerlendirme Dergisi https://doi.org/10.21031/epod.394323 (2018).

Asparouhov, T. & Muthén, B. Exploratory structural equation modeling. Struct. Eq. Model. Multidiscip. J. 16 (3), 397–438 (2009).

Article   MathSciNet   Google Scholar  

Finch, H., French, B. F., & Immekus, J. C. Applied psychometrics using spss and amos. IAP (2016).

Marsh, H. W., Guo, J., Dicke, T., Parker, P. D. & Craven, R. G. Confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), and Set-ESEM: Optimal balance between goodness of fit and parsimony. Multivar. Behav. Res. 55 (1), 102–119. https://doi.org/10.1080/00273171.2019.1602503 (2020).

Download references

Acknowledgements

Thanks to the editorial team and reviewers of Scientific Reports for their valuable comments.

Author information

Authors and affiliations.

Faculty of Education, SEGI University, 47810 Petaling Jaya, Selangor, Malaysia

Department of Art and Design, Zhengzhou College of Finance and Economics, Zhengzhou, 450000, Henan, China

Xiaolei Fan

Faculty of Humanities and Arts, Macau University of Science and Technology, Avenida Wai Long, 999078, Taipa, Macao, Special Administrative Region of China

Lingchao Meng

You can also search for this author in PubMed   Google Scholar

Contributions

D.L. Conceptualized a text experiment, and wrote the main manuscript text. D.L. and X.F. conducted experiments, D.L., X.F. and L.M. analyzed the results. L.M. contributed to the conceptualization, methodology and editing, and critically reviewed the manuscript. All authors have reviewed the manuscript.

Corresponding author

Correspondence to Lingchao Meng .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .

Reprints and permissions

About this article

Cite this article.

Li, D., Fan, X. & Meng, L. Development and validation of a higher-order thinking skills (HOTS) scale for major students in the interior design discipline for blended learning. Sci Rep 14 , 20287 (2024). https://doi.org/10.1038/s41598-024-70908-3

Download citation

Received : 28 February 2024

Accepted : 22 August 2024

Published : 31 August 2024

DOI : https://doi.org/10.1038/s41598-024-70908-3

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Assessment scale
• Higher-order thinking skills
• Interior design
• Blended learning

By submitting a comment you agree to abide by our Terms and Community Guidelines . If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Sign up for the Nature Briefing: Anthropocene newsletter — what matters in anthropocene research, free to your inbox weekly.

• Global Issues
• Community Projects

Creative Writing

• Storytelling
• Problem-Solving Method
• Real World Issues
• Future Scenarios
• Authentic Assessments
• 5Cs of Learning
• Youth Protection
• DEIB Commitment
• International Conference
• Find FPS Near Me
• Partner With Us

At a Glance

Program overview, 3 competition divisions.

Junior – Grades 4 to 6 Middle – Grades 7 to 9 Senior – Grades 10 to 12

Individual Event

Students compete individually, often as a complement to Global Issues and/or Storytelling competitions.

1 Original Short Story

Students pick one of the four annual problem topics on which to write a related short story.

Student Work Requirements

Students write 1,500 words or less imagining the logical outcome of actions or events set at least 20 years in the future.

Non-Competitive Activities

Teachers often integrate Creative Writing as a standalone activity in their classrooms or other settings.

How It Works

Students get creative while refining their story writing skills, authentic assessment.

Registered students receive authentic assessment from trained evaluators on their competitive writing submission. Our rubric-based evaluations share learner-focused feedback to help students meet and exceed educational standards as they strengthen their writing skills.

Competition Season

Regional affiliates may use a one or two submission approach for their competition. If two are allowed, the first submission is non-competitive and receives written feedback to guide the story’s improvement. If a local affiliate does not offer Creative Writing, their students may compete with our Open affiliate.

World Finals Qualification

We invite all regional affiliate champions to attend our International Conference in June and compete alongside their peers. We announce the problem topic on March 1 each year for use at our world finals event. At the conference, students use a topic-related future scene with time, place, and topic parameters as inspiration for their story. They may write up to 1,000 words within a given time limit.

Season 2024-2025 Topics

Our real world topics are future-focused.

Food Security

How might food security issues of availability, access, and affordability essential for living a healthy life impact society in the future?

Rising Sea Levels

How might we address the impact of rising sea levels on coastlines, industries, and people in the future?

Agricultural Industry

How might the agricultural industry adapt to the needs of feeding a growing world population in the future?

Nanotechnology

How might the use of nanotechnology in medicine, healthcare, and other industries affect humanity in the future?

Student Showcase

Lifetime skills on display.

Antibiotic Resistance

Superbugged Junior Division 2019 2nd Place Champion Rachel (Singapore)

Building Green

The Big Bird Middle Division 2022 Champion Omar (Ohio)

Gamification

Easy Money Senior Division 2020 Champion Kaitlyn (Illinois)

Qualify for International Conference

Questions find the answers here..

Find everything else you need to know about Creative Writing in our Resources Library . In addition, check the answers to other common Future Problem Solving questions.

Visit our Resources Library to learn more about our future scenario writing program and be inspired by our students’ work. Find everything you need to know to get started as well as examples of the International Conference future scene and our rubric-based evaluations.

No, it is not a requirement. However, knowledge of the Future Problem Solving process helps students think about the future and organize a storyline. We do recommend students complete the background reading and research on their chosen topic since their stories must relate to the topic.

A submitted work must be original and fully student-created. Coaches may provide direct instruction on creative writing, read the student’s work, ask questions that occur to them as a reader, and make general suggestions for improvement. Authors may also receive assistance to correct spelling, grammar, and punctuation errors. Peer revision is a beneficial process, too. Be careful with automated writing tools (including AI). Only use them for proofreading or to spark ideas.

Students participate through schools, clubs, or independently through a Future Problem Solving regional affiliate . Every individual works alongside an adult who serves as their coach or adult liaison. While coaches are often educators who may utilize their classroom time for Future Problem Solving, anyone may serve as a coach. Parents, administrators, retired teachers, alumni, and other professionals interested in helping students become better prepared for the future are all welcome. Often, experienced Future Problem Solving students (with an adult sponsor) also serve as coaches for younger students.

All coaches gain access to program materials designed to help them guide their students through the problem-solving and creative writing processes as well as prepare for each topic. The registration fees also cover all evaluation and feedback on student submissions. Topic learning units are also available for purchase. Each unit contains background research, more suggested readings, discussion questions, learning prompts, and assessment resources. Additional fees may be required for regional affiliate and world finals. For more information on local fees and schedules, contact your Future Problem Solving regional affiliate .

Future Problem Solving Students – A Five Year Study

A comparison of reading and mathematics performance between students participating in a future problem solving program and nonparticipants.

Data from the The Minnesota Comprehensive Assessment (MCA) was collected by Grandview Middle School and provided to Scholastic Testing Service, Inc. for statistical analysis.

Findings reported by Scholastic Testing Service, Inc. Performance data on the MCA was collected from 2010-2014 for students in grade 6 at Grandview Middle School in Mound, MN (Westonka Public School District). Students were identified as either FPS: students participating in a Future Problem Solving program, or Non-FPS: students not participating in the program. Summary statistics using Reading and Mathematics Scaled Scores were developed for each group of students by year and across years. To determine if the mean scores across the years were significantly different, t-tests were used. A Cohen’s d test was then performed to measure the effect of the size of the found differences.

In all cases, students participating in the Future Problem Solving Program performed significantly higher on the MCA in both areas of Mathematics and Reading.

Effects of Group Training in Problem-Solving Style on Future Problem-Solving Performance

The journal of creative behavior (jcb) of the creative education foundation.

Seventy-five participants from one suburban high school formed 21 teams with 3–4 members each for Future Problem Solving (FPS). Students were selected to participate in either the regular FPS or an enhanced FPS, where multiple group training activities grounded in problem-solving style were incorporated into a 9-week treatment period.

An ANCOVA procedure was used to examine the difference in team responses to a creative problem-solving scenario for members of each group, after accounting for initial differences in creative problem-solving performance, years of experience in FPS, and creative thinking related to fluency, flexibility, and originality. The ANCOVA resulted in a significant difference in problem-solving performance in favor of students in the treatment group (F(1, 57) = 8.21, p = .006, partial eta squared = .126, medium), while there were no significant differences in years of experience or creativity scores. This result led researchers to conclude that students in both groups had equivalent creative ability and that participation in the group activities emphasizing problem-solving style significantly contributed to creative performance.

In the comparison group, a total of 47% had scores that qualified for entry to the state competition. In contrast, 89% of the students in the treatment group had scores that qualified them for the state bowl. None of the teams from the comparison group qualified for the international competition, while two teams from the treatment group were selected, with one earning sixth place.

The results of this study suggest that problem-solving performance by team members can be improved through direct instruction in problem-solving style, particularly when there is a focus on group dynamics.

The Journal of Creative Behavior, Vol. 0, Iss. 0, pp. 1–12 © 2017 by the Creative Education Foundation, Inc. DOI: 10.1002/jocb.176

Future Problem Solving Program International—Second Generation Study

“how important was future problem solving in the development of your following skill sets”.

In 2011, a team of researchers from the University of Virginia submitted a report titled “Future Problem Solving Program International—Second Generation Study.” (Callahan, Alimin, & Uguz, 2012). The study, based on a survey, collected data from over 150 Future Problem Solving alumni to understand the impact of their participation in Future Problem Solving as students or volunteers.

Percentage of Alumni Rating Important and Extremely Important in Developing Skill Sets

• 96% Look at the “Big Picture”
• 93% Critical Thinking
• 93% Teamwork and Collaboration
• 93% Identify and Solve Problems
• 93% Time Management
• 90% Researching
• 90% Evaluation and Decision Making
• 86% Creativity and Innovation
• 86% Written Communication

The report captured alumni’s positive experiences as students in Future Problem Solving and documented that the alumni continued to utilize the FPS-structured approach to solving problems in their adult lives.

Executive Director

A seasoned educator, April Michele has served as the Executive Director since 2018 and been with Future Problem Solving more than a decade. Her background in advanced curriculum strategies and highly engaging learning techniques translates well in the development of materials, publications, training, and marketing for the organization and its global network. April’s expertise includes pedagogy and strategies for critical and creative thinking and providing quality educational services for students and adults worldwide.

Prior to joining Future Problem Solving, April taught elementary and middle grades, spending most of her classroom career in gifted education. She earned the National Board certification (NBPTS) as a Middle Childhood/Generalist and later served as a National Board assessor for the certification of others. In addition, April facilitated the Theory and Development of Creativity course for the state of Florida’s certification of teachers. She has also collaborated on a variety of special projects through the Department of Education. Beyond her U.S. education credentials, she has been trained for the International Baccalaureate Middle Years Programme (MYP) in Humanities.

A graduate of the University of Central Florida with a bachelor’s in Elementary Education and the University of South Florida with a master’s in Gifted Education, April’s passion is providing a challenging curriculum for 21st century students so they are equipped with the problem-solving and ethical leadership skills they need to thrive in the future. As a board member in her local Rotary Club, she facilitates problem solving in leadership at the Rotary Youth Leadership Awards (RYLA). She is also a certified Project Management Professional (PMP) from the Project Management Institute and earned her certificate in Nonprofit Management from the Edyth Bush Institute at Rollins College.