labvanced logoLabVanced
Contact
    • Remote Physiological Measurements
    • Eye Tracking
    • Head & Face-Tracking
    • Emotion Detection
    • Heart Rate Detection (rPPG)
    • Generative AI
    • Audio Transcription
    • EEG & Hardware Integrations
    • Decision Making
    • Reaction Times
    • Keyboard Inputs
    • Mouse Tracking
    • Mobile / Touch
    • Questionnaires
    • Gamepad / Joystick Integration
    • Audio Recordings
    • Audio Transcription
    • Video Recordings
    • Screen Recordings
    • Photos / Snapshots
    • Video Conferencing
    • Canvas Drawings
    • Build with AI
    • Build with Spreadsheets
    • Using the Experiment Editor
    • Coding
    • Creating Questionnaires
    • Balancing & Randomization
    • UX & Website Testing
    • Single Session Studies
    • Factorial Designs
    • Longitudinal & Multi-session Studies
    • Individual & Case Studies
    • Real-time Multi-user Studies
    • Interviews & Video Calls
    • Surveys & Questionnaires
    • Experience Sampling & Diaries
    • Classroom & Group Testing
    • Interventions & Clinical Trials
    • In the Browser
    • Mobile App
    • Desktop App
    • WebBridge Chrome Extension
    • Stroop Test
    • Flanker Task
    • N-back Task
    • Implicit Association Test
    • Trail Making Test
    • Digit Span
    • Corsi Block Tapping
    • Tower of London
    • Balloon Analog Risk Task
    • Preferential Looking
    • Browse more →
    • DASS-21
    • GAD-7
    • Rosenberg Self-Esteem Scale
    • PHQ-9
    • Ten-Item Personality Inventory
    • Big Five Personality Test
    • Adult ADHD Self-Report Scale
    • Browse more →
    • Building a Multi-user Study
    • Webcam Eye Tracking with AOIs
    • Website Frame Eye Tracking
    • Conditional Eye Tracking Opt-in
    • ChatGPT Study
    • Desktop App Study with EEG
    • Between-subjects Group Balancing
    • Building a Reading Study
    • Stroop Task
    • Lexical Decision Task
    • Browse more →
    Public Experiment Library
    • Arts Research
    • Clinical Psychology & Neuropsychology Medicine
    • Cognitive Psychology
    • Developmental Psychology
    • Behavioral Economics & Decision Science
    • Educational Research & Psychology
    • HCI & Human Factors
    • Linguistics & Language Sciences
    • Consumer & Marketing Research
    • Social & Personality Psychology
    • Sport & Movement Science
    • UX & Website Testing
    • Executive Functions
    • Language & Reading
    • Decision-Making & Reasoning
    • Attention
    • Overview
    • HCI & Human Factors
    • UX & Website Testing
    • Consumer & Marketing Research
    • White-Label App
    • PageGazer
    • Webcam vs. Lab Eye Tracking in InfantsAnna Banki & Gabriela Markova
    • Eye Tracking for Influencer MarketingDr. Alexander Edeling
    • Eye Tracking Infant Word ComprehensionDr. Giulia Calignano
    • Sentence Reading and Grammar JudgmentsDr. Jonathan Mirault
    • Regulating Emotions with MusicDr. Katrin Starcke
    • Game-Based Grammar Learning in ChildrenDr. Mireia Marimon
    • Gaze Cueing and AutismMax Soares Miehstein
    • Personality and Hearing in NoiseDr. Malte Wöstmann
    • All interviews →
    • Lab Notes
    • How to Cite Labvanced
    • Labvanced Platform Paper (2017)
    • Webcam Eye Tracking Validation (2024)
    • Webcam Eye Tracking Studies
    • Cognitive Psychology Studies
    • Developmental Psychology Studies
    • Linguistics Studies
    • See all publications →
    • Getting Started
    • Guide
    • Video Tutorials
    • Walkthroughs
    • Live Chat
    • Webinars & Onboarding Calls
    • AI Assistant
    • FAQ
    • Importing Templates Guide
    • Test Templates
    • Live Eye Tracking Metrics
    • Mouse Tracking Demo
    • ChatGPT Demo
    • Audio Recording Object Demo
    • Adding Image Stimuli Demo
    • Score & Feedback Demo
    • Browse all technical demos →
    • Timing Precision
    • Stimuli Presentation
    • Headphone Checks
    • Bot Checks
    • Participant Management
    • Comparisons
    • Research Blog
    • Prolific Integration
    • CloudResearch Integration
    • Sona Systems Integration
    • BeSample Integration
    • Panelabs Integration
    • Clickworker Integration
    • Labvanced Webhook API
    • Labvanced REST API
    • About Us
    • Newsletter Archive
    • Terms & Conditions
    • Data Security & Data Privacy
    • Technical & Organisational Measures
    • Accessibility
    • W-8BEN-E Form
    • Data Processing Agreement Template
    LinkedInYouTubeDiscord
    • Individual
    • Lab
    • Department / Consortium
    • Teaching
    • Campus
    • Commercial
    • Browse recording top-ups →
    • Browse AI token top-ups →
    • Overview
    • Study Building
    • Subject Recruitment
    • Dedicated Support
    Checkout
  • Contact
    • EN
      • 中國人
      • Deutsch
      • Français
      • Español
      • English
      • 日本語
    • Logout
    • Loginlogin icon
    Platform
    Labvanced makes it easy to implement the most advanced study design and reliably collect your data.
    Biosignals & AI
    Remote Physiological MeasurementsEye TrackingHead & Face-TrackingEmotion DetectionHeart Rate Detection (rPPG)Generative AIAudio TranscriptionEEG & Hardware Integrations
    Behavioral Recordings
    Decision MakingReaction TimesKeyboard InputsMouse TrackingMobile / TouchQuestionnairesGamepad / Joystick Integration
    Media Recordings
    Audio RecordingsAudio TranscriptionVideo RecordingsScreen RecordingsPhotos / SnapshotsVideo ConferencingCanvas Drawings
    Implementation Techniques
    Build with AIBuild with SpreadsheetsUsing the Experiment EditorCodingCreating QuestionnairesBalancing & RandomizationUX & Website Testing
    Study Formats

    Your study can take whatever format your research needs. Here are a few popular examples.

    Single Session StudiesFactorial DesignsLongitudinal & Multi-session StudiesIndividual & Case StudiesReal-time Multi-user StudiesInterviews & Video CallsSurveys & QuestionnairesExperience Sampling & DiariesClassroom & Group TestingInterventions & Clinical Trials
    Where Studies Run

    Run your study online in the browser, on mobile or tablet with the mobile app, or in-lab with the desktop app.

    In the BrowserMobile AppDesktop AppWebBridge Chrome Extension
    Tests
    Explore cognitive tests, questionnaires, walkthroughs, and our public experiment library: a starting point for your next study.
    Popular Cognitive Tests
    Stroop TestFlanker TaskN-back TaskImplicit Association TestTrail Making TestDigit SpanCorsi Block TappingTower of LondonBalloon Analog Risk TaskPreferential Looking
    Browse more →
    Questionnaires & Scales
    DASS-21GAD-7Rosenberg Self-Esteem ScalePHQ-9Ten-Item Personality InventoryBig Five Personality TestAdult ADHD Self-Report Scale
    Browse more →
    Public Experiment Library

    Take a look at what other researchers in the community are doing through our extensive, open catalog of shared studies.

    Open the public library →
    Walkthroughs

    Step-by-step builds of complete studies, from a blank project to a running experiment, that you can follow along or adapt.

    Building a Multi-user StudyWebcam Eye Tracking with AOIsWebsite Frame Eye TrackingConditional Eye Tracking Opt-inChatGPT StudyDesktop App Study with EEGBetween-subjects Group BalancingBuilding a Reading StudyStroop TaskLexical Decision Task
    Browse more →
    Research
    One platform for students, academics, and industry researchers studying human behavior.
    Harvard UniversityStanford UniversityCambridge UniversityUCLNYUMax Planck InstituteUCLATU Munich

    Trusted by researchers at 1,500+ universities worldwide

    Academic Research
    Arts ResearchClinical Psychology & Neuropsychology MedicineCognitive PsychologyDevelopmental PsychologyBehavioral Economics & Decision ScienceEducational Research & PsychologyHCI & Human FactorsLinguistics & Language SciencesConsumer & Marketing ResearchSocial & Personality PsychologySport & Movement ScienceUX & Website Testing
    Research Areas
    Executive FunctionsLanguage & ReadingDecision-Making & ReasoningAttention
    Industry / Commercial
    OverviewHCI & Human FactorsUX & Website TestingConsumer & Marketing ResearchWhite-Label AppPageGazer
    Researcher Interviews

    Conversations with researchers about the studies they ran with Labvanced, what worked, and what they learned.

    Webcam vs. Lab Eye Tracking in InfantsAnna Banki & Gabriela MarkovaEye Tracking for Influencer MarketingDr. Alexander EdelingEye Tracking Infant Word ComprehensionDr. Giulia CalignanoSentence Reading and Grammar JudgmentsDr. Jonathan MiraultRegulating Emotions with MusicDr. Katrin StarckeGame-Based Grammar Learning in ChildrenDr. Mireia MarimonGaze Cueing and AutismMax Soares MiehsteinPersonality and Hearing in NoiseDr. Malte Wöstmann
    All interviews →
    Our Research
    Lab NotesHow to Cite Labvanced
    Peer Reviewed Studies

    A selection of peer-reviewed work built on Labvanced: our own platform and validation papers, and studies by the research community grouped by area. Hundreds more are listed on the full publications page.

    Labvanced Platform Paper (2017)Webcam Eye Tracking Validation (2024)Webcam Eye Tracking StudiesCognitive Psychology StudiesDevelopmental Psychology StudiesLinguistics Studies
    See all publications →
    Resources
    Valuable resources to help you learn the platform, stay updated, and more.
    Documentation
    Getting StartedGuideVideo TutorialsWalkthroughs
    Support
    Live ChatWebinars & Onboarding CallsAI AssistantFAQ
    Templates & Demos

    These are a few popular examples. Browse our guide and a selection of technical demos to get started with implementation.

    Importing Templates GuideTest TemplatesLive Eye Tracking MetricsMouse Tracking DemoChatGPT DemoAudio Recording Object DemoAdding Image Stimuli DemoScore & Feedback Demo
    Browse all technical demos →
    Methodology
    Timing PrecisionStimuli PresentationHeadphone ChecksBot ChecksParticipant ManagementComparisonsResearch Blog
    Integrations & APIs
    Prolific IntegrationCloudResearch IntegrationSona Systems IntegrationBeSample IntegrationPanelabs IntegrationClickworker IntegrationLabvanced Webhook APILabvanced REST API
    Company & Legal
    About UsNewsletter ArchiveTerms & ConditionsData Security & Data PrivacyTechnical & Organisational MeasuresAccessibilityW-8BEN-E FormData Processing Agreement Template
    LinkedInYouTubeDiscord
    Pricing
    Our licenses and additional services at a glance.
    Licenses
    IndividualLabDepartment / ConsortiumTeachingCampusCommercial
    Top-Ups

    Need more recordings for your lab or your own research? Simply use one of these recording top-up packages.

    Browse recording top-ups →

    Need more AI tokens for the AI assistant and study translations? Simply use one of these AI token top-up packages.

    Browse AI token top-ups →
    Additional Services

    Hire Labvanced’s expert team to quickly bring your project to the level of rigor it needs.

    OverviewStudy BuildingSubject RecruitmentDedicated Support
    Checkout

    Ready to purchase a license or top-up? Head straight to checkout.

    Go to checkout →
    • 中國人
    • Deutsch
    • Français
    • Español
    • English
    • 日本語
    Card Sorting Task header showing four reference cards and one card to sort, each varying in color, shape, and number of symbols.

    Card Sorting Task

    This card sorting task is a computer-based neuropsychological assessment designed to evaluate cognitive flexibility, rule-shifting, and executive control. Participants are asked to match cards according to rules that change over time, allowing the task to measure how effectively an individual can learn, adapt, and modify strategies in response to changing environments. This task is widely used in clinical, research, and applied performance settings.

    Table of Contents

    • Task Format
    • Data Collected
    • Technology
    • Customization
    • Recommended Use

    Task Structure

    In this card sorting test, participants see one card at the top of the screen and four cards displayed below it. Each card varies in colour, shape, and number of items. The participant’s task is to select the bottom card that matches the top card according to a hidden sorting rule. After each choice, feedback appears indicating whether the selection was correct or wrong. Participants must use this feedback to infer the current sorting rule. A short practice block is provided first, requiring ten consecutive correct responses. In the main task, the sorting rule can be based on colour, form, or the number of figures, and it can change at any time without warning. Participants must stay attentive, adapt quickly, and adjust their selections whenever the rule shifts. At the end of the task, participants also receive a brief results summary showing their total correct responses, overall errors, and a breakdown of perseverative and other error types.

    Data Collected and Behavioral Metrics

    This card sorting test generates a rich set of performance variables that capture how participants interpret feedback, adjust their strategies, and handle unexpected shifts in sorting rules. These metrics provide a comprehensive view of cognitive flexibility, problem solving, and sustained rule maintenance. In the Variables Tab, you will see all measures recorded during the card sorting task in Labvanced. Below are several of the most informative indicators that researchers frequently analyze in this version of the task.

    These variables can be renamed, expanded, or supplemented with additional measures depending on your research needs.

    Variable NameDescription
    total_correctTotal number of correct responses across the trials
    total_errorsTotal number of wrong responses across the trials
    count_PECount of perseverative errors, where the participant continued using a previous rule despite feedback
    count_NPECount of non-perseverative errors, which do not relate to the old rule, such as inconsistent choices or wrong guesses
    accuracyWhether the participant's choice was correct for the current sorting rule (true/false)
    RTReaction time for the trial
    current_ruleName of the active sorting rule for the current trial (number, color, or shape)
    hasRuleChangeWhether the sorting rule changed on this trial (true/false)
    Data preview of trial-level responses collected with the Card Sorting Task in Labvanced, showing accuracy, the card chosen, its color, number, and shape, error counts, the active rule, rule changes, progress, and reaction time.
    Preview of data collected with the Card Sorting Task in Labvanced: one row per trial, with response accuracy, the card chosen and its color, number, and shape, running counts of perseverative and non-perseverative errors, the active sorting rule, whether the rule just changed, task progress, and reaction time in milliseconds.

    Card Sorting Task

    This study measures how quickly people adapt when the rules change. Participants match a card to one of four reference cards by color, shape, or number, use feedback to work out the hidden rule, and switch strategies when the rule changes without warning.


    Technologies Supporting Card Sorting Research

    Administering the card sorting task benefits from several integrated technologies that strengthen data quality, support diverse testing situations, and allow researchers to scale their studies across devices and locations.

    • Millisecond Accurate Event Handling: Labvanced records responses and feedback timing with millisecond precision, making it possible to measure rapid shifts in decision making and the exact moment participants adapt to rule changes.

    • Integrated Webcam Based Eye Tracking: Researchers can optionally record gaze patterns using the built in webcam eye tracking solution, enabling analysis of how participants scan cards, search for relevant features, and visually explore rule possibilities without requiring specialized hardware.

    • Optimized Performance Across Devices: Card sorting studies can be administered on desktops, laptops, and tablets using either mouse or touchscreen input. The platform automatically calibrates object placement and timing to ensure consistent performance on different screen sizes.

    • Desktop App for Lab-based Research: For lab based studies, the Labvanced Desktop App provides a stable testing environment (without the need of an internet connection) and the option to integrate hardware such as EEG and sensors via the Lab Streaming Layer, allowing synchronized multimodal data collection.

    • Remote Testing and Session Management: The task can be deployed to participants anywhere in the world, with built in session management, progress tracking, and secure data storage. This enables longitudinal card sorting studies where cognitive changes can be monitored over multiple sessions.

    • Custom Event Logic and Real Time Monitoring: Labvanced allows researchers to embed conditional logic, adaptive rule changes, and automated scoring within the task itself. Real time video recording tools also make it possible to monitor participant progress during live sessions when needed.

    A person looking at a webcam eye tracking task created with Labvanced during a trail making test task

    Webcam Eye Tracking

    Capture gaze patterns and visual attention with built-in, code-free and peer-reviewed webcam eye-tracking.

    An icon of a clock symbolizing accurate reaction times from this trail making test template

    Timing Precision

    Capture reaction times, task performance, and more with millisecond accuracy for time-sensitive tasks.

    An image of the desktop app of Labvanced used to modify the trail making test template

    Desktop App

    Run in-lab studies using the Desktop App, compatible with EEG and other LSL-connected lab hardware.

    Customizing the Template

    There are many ways to go about customizing this card sorting task template. Below are a few themes researchers commonly ask when it comes to modifying this task.


    Stimulus Set

    Replace the default card images with your own color, shape, or symbolic stimuli using the ‘Object Properties’ panel.


    Rule Structure and Difficulty Settings

    Modify how often the sorting rule changes, adjust the number of consecutive correct responses required before a shift, or customize the order in which rules appear. The event system could be utilized to set up any presentation rule or level of difficulty.


    Instruction and Training Modifications

    Rewrite or expand the instruction screens to match the needs of children, clinical groups, or multilingual samples. You can also lengthen the practice phase, adjust feedback clarity, or incorporate comprehension checks, all by just clicking on the text object on frame.


    Timing and Task Flow Adjustments

    Change trial durations and feedback display times to suit your research design. These can be modified through ‘Delayed Action’ or frame specific timing controls. Frame navigation and progression can be modified by editing existing events or adding new ones by clicking on the ‘Add Frame Event’ under the events tab.


    Integration With Other Modalities

    Combine the task with wearable devices, eye tracking, or LSL compatible hardware using the Labvanced Desktop App. This allows synchronized multimodal data collection for more complex cognitive neuroscience studies.


    If you need help customizing this task, please feel welcome to write to us and ask:


    Contact Us

    Applications and Target Populations

    This card sorting test is suitable for a wide range of populations and research goals. It is particularly valuable when studying conditions that affect executive function, cognitive flexibility, and rule guided behavior.

    • Neurological and Brain-Injury Populations: Commonly used in assessments involving frontal lobe dysfunction, traumatic brain injury, stroke, epilepsy, and neurodegenerative conditions, where impairments in set shifting and rule learning are often observed.

    • Psychiatric and Behavioral Health Groups: Relevant for studying executive functioning in conditions such as ADHD, schizophrenia, bipolar disorder, and mood-related disorders, providing insight into difficulties with adaptation, feedback use, and maintaining strategies.

    • Aging and related Conditions: Useful for monitoring age related changes in executive functioning and identifying early markers of cognitive decline in older adults.

    • Developmental and Educational Research: Appropriate for examining problem solving, strategy formation, and flexibility in children, adolescents, and emerging adults, especially when exploring cognitive maturation or learning patterns.

    • Occupational and High Performance Screening: Beneficial in fields such as aviation, emergency services, transportation, and other roles requiring rapid adaptation and decision making under shifting conditions.

    As the version in Labvanced is simply a template, researchers to use to edit and create their own card sorting versions.


    Sign Up


    References

    • Berg, E. A. (1948). A simple objective technique for measuring flexibility in thinking. Journal of General Psychology, 39, 15–22. https://doi.org/10.1080/00221309.1948.9918159

    • Miles, S., Howlett, C.A., Berryman, C. et al. Considerations for using the Wisconsin Card Sorting Test to assess cognitive flexibility. Behav Res 53, 2083–2091 (2021). https://doi.org/10.3758/s13428-021-01551-3

    Related Tasks

    The Card Sorting Test pairs naturally with other cognitive flexibility and executive function tasks in Labvanced's task library.

    Trail Making Test

    In Part A, the participant connects numbers in ascending order (1-2-3...) while in Part B, numbers and letters alternate (1-A-2-B...), in this classic task for measuring cognitive flexibility.

    N-Back (2-back) Task

    This task examines working memory capacity using the 2-back task. Participants complete a series of trials where they must indicate if the current stimulus matches the one presented two steps earlier. Training trials and immediate feedback are provided to support learning and engagement.