labvanced logoLabVanced
Contact
    • Remote Physiological Measurements
    • Eye Tracking
    • Head & Face-Tracking
    • Emotion Detection
    • Heart Rate Detection (rPPG)
    • Generative AI
    • Audio Transcription
    • EEG & Hardware Integrations
    • Decision Making
    • Reaction Times
    • Keyboard Inputs
    • Mouse Tracking
    • Mobile / Touch
    • Questionnaires
    • Gamepad / Joystick Integration
    • Audio Recordings
    • Audio Transcription
    • Video Recordings
    • Screen Recordings
    • Photos / Snapshots
    • Video Conferencing
    • Canvas Drawings
    • Build with AI
    • Build with Spreadsheets
    • Using the Experiment Editor
    • Coding
    • Creating Questionnaires
    • Balancing & Randomization
    • UX & Website Testing
    • Single Session Studies
    • Factorial Designs
    • Longitudinal & Multi-session Studies
    • Individual & Case Studies
    • Real-time Multi-user Studies
    • Interviews & Video Calls
    • Surveys & Questionnaires
    • Experience Sampling & Diaries
    • Classroom & Group Testing
    • Interventions & Clinical Trials
    • In the Browser
    • Mobile App
    • Desktop App
    • WebBridge Chrome Extension
    • Stroop Test
    • Flanker Task
    • N-back Task
    • Implicit Association Test
    • Trail Making Test
    • Digit Span
    • Corsi Block Tapping
    • Tower of London
    • Balloon Analog Risk Task
    • Preferential Looking
    • Browse more →
    • DASS-21
    • GAD-7
    • Rosenberg Self-Esteem Scale
    • PHQ-9
    • Ten-Item Personality Inventory
    • Big Five Personality Test
    • Adult ADHD Self-Report Scale
    • Browse more →
    • Building a Multi-user Study
    • Webcam Eye Tracking with AOIs
    • Website Frame Eye Tracking
    • Conditional Eye Tracking Opt-in
    • ChatGPT Study
    • Desktop App Study with EEG
    • Between-subjects Group Balancing
    • Building a Reading Study
    • Stroop Task
    • Lexical Decision Task
    • Browse more →
    Public Experiment Library
    • Arts Research
    • Clinical Psychology & Neuropsychology Medicine
    • Cognitive Psychology
    • Developmental Psychology
    • Behavioral Economics & Decision Science
    • Educational Research & Psychology
    • HCI & Human Factors
    • Linguistics & Language Sciences
    • Consumer & Marketing Research
    • Social & Personality Psychology
    • Sport & Movement Science
    • UX & Website Testing
    • Executive Functions
    • Language & Reading
    • Decision-Making & Reasoning
    • Attention
    • Overview
    • HCI & Human Factors
    • UX & Website Testing
    • Consumer & Marketing Research
    • White-Label App
    • PageGazer
    • Webcam vs. Lab Eye Tracking in InfantsAnna Banki & Gabriela Markova
    • Eye Tracking for Influencer MarketingDr. Alexander Edeling
    • Eye Tracking Infant Word ComprehensionDr. Giulia Calignano
    • Sentence Reading and Grammar JudgmentsDr. Jonathan Mirault
    • Regulating Emotions with MusicDr. Katrin Starcke
    • Game-Based Grammar Learning in ChildrenDr. Mireia Marimon
    • Gaze Cueing and AutismMax Soares Miehstein
    • Personality and Hearing in NoiseDr. Malte Wöstmann
    • All interviews →
    • Lab Notes
    • How to Cite Labvanced
    • Labvanced Platform Paper (2017)
    • Webcam Eye Tracking Validation (2024)
    • Webcam Eye Tracking Studies
    • Cognitive Psychology Studies
    • Developmental Psychology Studies
    • Linguistics Studies
    • See all publications →
    • Getting Started
    • Guide
    • Video Tutorials
    • Walkthroughs
    • Live Chat
    • Webinars & Onboarding Calls
    • AI Assistant
    • FAQ
    • Importing Templates Guide
    • Test Templates
    • Live Eye Tracking Metrics
    • Mouse Tracking Demo
    • ChatGPT Demo
    • Audio Recording Object Demo
    • Adding Image Stimuli Demo
    • Score & Feedback Demo
    • Browse all technical demos →
    • Timing Precision
    • Stimuli Presentation
    • Headphone Checks
    • Bot Checks
    • Participant Management
    • Comparisons
    • Research Blog
    • Prolific Integration
    • CloudResearch Integration
    • Sona Systems Integration
    • BeSample Integration
    • Panelabs Integration
    • Clickworker Integration
    • Labvanced Webhook API
    • Labvanced REST API
    • About Us
    • Newsletter Archive
    • Terms & Conditions
    • Data Security & Data Privacy
    • Technical & Organisational Measures
    • Accessibility
    • W-8BEN-E Form
    • Data Processing Agreement Template
    LinkedInYouTubeDiscord
    • Individual
    • Lab
    • Department / Consortium
    • Teaching
    • Campus
    • Commercial
    Top-Ups
    • Overview
    • Study Building
    • Subject Recruitment
    • Dedicated Support
    Checkout
  • Contact
    • EN
      • 中國人
      • Deutsch
      • Français
      • Español
      • English
      • 日本語
    • Appgo to app icon
    • Loginlogin icon
    Platform
    Labvanced makes it easy to implement the most advanced study design and reliably collect your data.
    Biosignals & AI
    Remote Physiological MeasurementsEye TrackingHead & Face-TrackingEmotion DetectionHeart Rate Detection (rPPG)Generative AIAudio TranscriptionEEG & Hardware Integrations
    Behavioral Recordings
    Decision MakingReaction TimesKeyboard InputsMouse TrackingMobile / TouchQuestionnairesGamepad / Joystick Integration
    Media Recordings
    Audio RecordingsAudio TranscriptionVideo RecordingsScreen RecordingsPhotos / SnapshotsVideo ConferencingCanvas Drawings
    Implementation Techniques
    Build with AIBuild with SpreadsheetsUsing the Experiment EditorCodingCreating QuestionnairesBalancing & RandomizationUX & Website Testing
    Study Formats

    Your study can take whatever format your research needs. Here are a few popular examples.

    Single Session StudiesFactorial DesignsLongitudinal & Multi-session StudiesIndividual & Case StudiesReal-time Multi-user StudiesInterviews & Video CallsSurveys & QuestionnairesExperience Sampling & DiariesClassroom & Group TestingInterventions & Clinical Trials
    Where Studies Run

    Run your study online in the browser, on mobile or tablet with the mobile app, or in-lab with the desktop app.

    In the BrowserMobile AppDesktop AppWebBridge Chrome Extension
    Tests
    Explore cognitive tests, questionnaires, walkthroughs, and our public experiment library: a starting point for your next study.
    Popular Cognitive Tests
    Stroop TestFlanker TaskN-back TaskImplicit Association TestTrail Making TestDigit SpanCorsi Block TappingTower of LondonBalloon Analog Risk TaskPreferential Looking
    Browse more →
    Questionnaires & Scales
    DASS-21GAD-7Rosenberg Self-Esteem ScalePHQ-9Ten-Item Personality InventoryBig Five Personality TestAdult ADHD Self-Report Scale
    Browse more →
    Public Experiment Library

    Take a look at what other researchers in the community are doing through our extensive, open catalog of shared studies.

    Open the public library →
    Walkthroughs

    Step-by-step builds of complete studies, from a blank project to a running experiment, that you can follow along or adapt.

    Building a Multi-user StudyWebcam Eye Tracking with AOIsWebsite Frame Eye TrackingConditional Eye Tracking Opt-inChatGPT StudyDesktop App Study with EEGBetween-subjects Group BalancingBuilding a Reading StudyStroop TaskLexical Decision Task
    Browse more →
    Research
    One platform for students, academics, and industry researchers studying human behavior.
    Harvard UniversityStanford UniversityCambridge UniversityUCLNYUMax Planck InstituteUCLATU Munich

    Trusted by researchers at 1,500+ universities worldwide

    Academic Research
    Arts ResearchClinical Psychology & Neuropsychology MedicineCognitive PsychologyDevelopmental PsychologyBehavioral Economics & Decision ScienceEducational Research & PsychologyHCI & Human FactorsLinguistics & Language SciencesConsumer & Marketing ResearchSocial & Personality PsychologySport & Movement ScienceUX & Website Testing
    Research Areas
    Executive FunctionsLanguage & ReadingDecision-Making & ReasoningAttention
    Industry / Commercial
    OverviewHCI & Human FactorsUX & Website TestingConsumer & Marketing ResearchWhite-Label AppPageGazer
    Researcher Interviews

    Conversations with researchers about the studies they ran with Labvanced, what worked, and what they learned.

    Webcam vs. Lab Eye Tracking in InfantsAnna Banki & Gabriela MarkovaEye Tracking for Influencer MarketingDr. Alexander EdelingEye Tracking Infant Word ComprehensionDr. Giulia CalignanoSentence Reading and Grammar JudgmentsDr. Jonathan MiraultRegulating Emotions with MusicDr. Katrin StarckeGame-Based Grammar Learning in ChildrenDr. Mireia MarimonGaze Cueing and AutismMax Soares MiehsteinPersonality and Hearing in NoiseDr. Malte Wöstmann
    All interviews →
    Our Research
    Lab NotesHow to Cite Labvanced
    Peer Reviewed Studies

    A selection of peer-reviewed work built on Labvanced: our own platform and validation papers, and studies by the research community grouped by area. Hundreds more are listed on the full publications page.

    Labvanced Platform Paper (2017)Webcam Eye Tracking Validation (2024)Webcam Eye Tracking StudiesCognitive Psychology StudiesDevelopmental Psychology StudiesLinguistics Studies
    See all publications →
    Resources
    Valuable resources to help you learn the platform, stay updated, and more.
    Documentation
    Getting StartedGuideVideo TutorialsWalkthroughs
    Support
    Live ChatWebinars & Onboarding CallsAI AssistantFAQ
    Templates & Demos

    These are a few popular examples. Browse our guide and a selection of technical demos to get started with implementation.

    Importing Templates GuideTest TemplatesLive Eye Tracking MetricsMouse Tracking DemoChatGPT DemoAudio Recording Object DemoAdding Image Stimuli DemoScore & Feedback Demo
    Browse all technical demos →
    Methodology
    Timing PrecisionStimuli PresentationHeadphone ChecksBot ChecksParticipant ManagementComparisonsResearch Blog
    Integrations & APIs
    Prolific IntegrationCloudResearch IntegrationSona Systems IntegrationBeSample IntegrationPanelabs IntegrationClickworker IntegrationLabvanced Webhook APILabvanced REST API
    Company & Legal
    About UsNewsletter ArchiveTerms & ConditionsData Security & Data PrivacyTechnical & Organisational MeasuresAccessibilityW-8BEN-E FormData Processing Agreement Template
    LinkedInYouTubeDiscord
    Pricing
    Our licenses and additional services at a glance.
    Licenses
    IndividualLabDepartment / ConsortiumTeachingCampusCommercial
    Top-Ups

    Need more recordings for your lab or your own research? Simply use one of these recording top-up packages.

    Browse top-up packages →
    Additional Services

    Hire Labvanced’s expert team to quickly bring your project to the level of rigor it needs.

    OverviewStudy BuildingSubject RecruitmentDedicated Support
    Checkout

    Ready to purchase a license or top-up? Head straight to checkout.

    Go to checkout →
    • 中國人
    • Deutsch
    • Français
    • Español
    • English
    • 日本語
    • Getting Started
    • Guide
      • GETTING STARTED

        • Task Editor
        • Frames
          • Canvas Frame
          • Page Frame
          • Website Frame
        • Trial Timeline
        • Stimulus Presentation
        • Correctness of Response
        • Objects
        • Events
        • Variables
        • Task Wizard
        • AI Assistant
        • Trial System
        • Experiment Design
          • Creating a Study
          • Importing Templates in Labvanced
          • Data Frame Patterns
          • Multi-user Experiment Design
          • Longitudinal Experiment Design
      • FEATURED TOPICS

        • Randomization & Balance
        • Eye Tracking
          • Presenting Stimuli in an Eye Tracking Task
          • How to Choose Eye Tracking Calibration Settings
          • Setting Up Eye Tracking in a Task
          • Recording and Exporting Gaze Data
          • Using Shapes as Areas of Interest (AOI) for Eye Tracking
          • The Participant Calibration Experience
        • Web Bridge
          • Selecting Website AOIs | Anchor, Adjust, and Verify AOI Tracking
          • Tracking Mouse Behavior on a Website AOI | Web Bridge Guide
        • Questionnaires
        • Desktop App
        • Sample Studies
        • Participant Recruitment
        • API Access
          • REST API
          • Webhook API
          • WebSocket API
        • Other Topics

          • Precise Stimulus Timings
          • Multi User Studies
          • Head Tracking in Labvanced | Guide
      • MAIN APP TABS

        • Overview: Main Tabs
        • Dashboard
        • My Studies
        • Shared Studies
        • My Files
        • Experiment Library
        • My Account
        • License & Services
      • STUDY TABS

        • Overview: Study-Specific Tabs
        • Study Design
          • Tasks
          • Blocks
          • Sessions
          • Groups
        • Task Editor
          • Task Controls
          • The Trial System
          • Frame Types
          • Objects
          • Object Property Tables
          • Variables
          • System Variables Table
          • The Event System
          • Text Editor Functions
          • Eye Tracking Options in the Task Editor
          • Head Tracking in a Task
          • Multi-User Studies
        • Settings
        • Variables
        • Media
        • Texts & Translate
        • Launch & Participate
        • Subject Management
        • Dataview and Export
    • Video Tutorials
      • Video Overview
      • Getting Started in Labvanced
      • Creating Tasks
      • Element Videos
      • Events & Variables
      • Advanced Topics
    • Walkthroughs
      • Introduction
      • Stroop Task
      • Lexical Decision Task
      • Posner Gaze Cueing Task
      • Change Blindness Flicker Paradigm
      • Eye-tracking Sample Study
      • Infant Eye-tracking Study
      • Attentional Capture Study with Mouse Tracking
      • Rapid Serial Visual Presentation
      • ChatGPT Study
      • Eye Tracking Demo: SVGs as AOIs
      • Multi-User Demo: Show Subjects' Cursors
      • Gamepad / Joystick Controller- Basic Set Up
      • Desktop App Study with EEG Integration
      • Between-subjects Group Balancing and Variable Setup
      • Building a Multi-user Study
      • Website Frame Eye Tracking Walkthrough
      • Conditional Webcam Eye Tracking
      • Text Segmentation Study Building
      • Building a Study with AI
    • FAQ
      • Features
      • Support Policy & Guidelines
      • Security & Data Privacy
      • Licensing
      • Precision of Labvanced
      • Programmatic Use & API
      • Using Labvanced Offline
      • Troubleshooting
      • Study Creation Questions
    Overview of randomization and balancing options for experimental design in Labvanced

    Randomization & Balancing

    With regards to randomization in experimental design, as well as balancing, Labvanced offers many approaches (discussed further below) to ensure your research is sound and free from bias. As this topic is crucial for successful research, the ability to handle randomization is presented up front in the main editor view.

    The area in Labvanced for handling randomization in experimental design

    A key area in Labvanced for handling randomization and balancing in your experiment.

    The image above points to the main area in the Labvanced editor for setting up different types of Randomizations and their levels can be found here as well as access to the Randomization Settings for specifying your requirements like trial order (eg: it should be fixed or random), how balancing should be handled, and more

    Randomization in Research

    Randomization in experiments and psychology research is an important mechanism to reduce bias and assure strong experimental design integrity. Randomization in experimental design and research is essentially the process of randomly assigning participants across different groups (treatment / intervention / experimental vs. control). By making this assignment process random, it assumes that all participants are equally likely to be assigned to any condition.

    In addition to participant assignment, randomization in experiments also refers to stimuli presentation and task order. Randomization in experimental design can address how tasks and stimuli are presented. As a theme, randomization in research is a major topic in experimental design and creation.

    In the example below, the Factor for the type of painting (Modern or Classic) has the Position of Modern Painting (Left or Right) randomized. Using the ‘Settings’ button, balancing requirements can also be stipulated.

    Example of randomization in an experiment

    An example of an experimental design setup using randomization for presenting the position of a particular image category.

    Examples of Randomization

    Randomization ExampleAimImplementation
    Randomizing presented stimuli, such as imagesRandomize which stimuli from a pool, such as images, are presented to the participant.Create the trials using the Trial System and specify the number of trials and trial order via the Randomization Settings.
    Randomizing the location of the ‘correct’ stimuliWhen two or more stimuli are presented as choices on the screen, it is crucial to randomize the presentation and their position.Instructions on a suggested approach for how this can be done is found in this sample study here. Simply click the ‘Inspect’ button and open the ‘Instructions’ task.

    Note: This is often combined with balancing options via the Randomization Settings.
    Random coordinate location of stimuliRandomize the x- and y- coordinates and assign them to a stimulus in order to randomize its position on the screen.Instructions on a suggested approach for how this can be done is found in this sample study here. Simply click the ‘Inspect’ button and open the ‘Task_Instructions’ task. This demo also describes how to randomly assign color.
    Random frame / stimuls timeRandomize the duration of how long a frame is presented.Instructions on a suggested approach for how this can be done is found in this sample study here. Simply click the ‘Inspect’ button and open the ‘task_instructions’ task.

    The video below gives a quick walkthrough of how to randomize your study in the Study Design tab as well as the Randomization menu in the Task Editor.

    Balancing in Research

    Balancing is an equally important concept. Balancing ensures that each condition is equally replicated, ie. any number of measurements or observations from each experimental condition (such as trial order) is equal. This is important because randomization relies on the ‘law of large numbers’ which for experiments with a small number of participants could ultimately result in an imbalanced design, unless taken care of. For example, by balancing, you can ensure that an equal number of participants follow a random trial order. A balanced experiment design further ensures that equal conditions are replicated.

    Examples of Balancing

    Balancing ExampleAimImplementation
    Balanced PositioningBalancing the position of certain stimuli may be required, such as ensuring that the ‘correct’ image was presented with an equal amount of trials for the left and right side position of the screen.Upon adding the Randomization levels, specify the balancing option you need.
    Styling of stimuliBalancing the styling of stimuli, such as having a red image border or a blue image border.Upon adding the Randomization levels, specify the balancing option you need.
    Nested design balancingNested design balancing requires multiple factors to be balanced. An example of this is balancing position (eg. left or right side for correct / wrong choices ) together with age of a face (eg. young or old). So if young faces are balanced for left and right, then old faces must also be balanced for both left and right positions.Upon adding the Randomization levels, select the Balanced Within Subject and Nested option.
    Between-participant balancingIn some instances, it may be necessary for one subject to see one version while the next subject a different version.Upon adding the Randomization levels, specify the balancing option you need.

    The image below shows the Randomization Settings dialog box, one of the many relevant areas in Labvanced for handling randomization and balancing requirements in your experiment design and setup.

    Randomization and Balance Settings for Trials and Conditions in Labvanced

    Randomization and Balance Settings for Trials and Conditions in Labvanced

    Balance & Randomization in Labvanced Experiments

    Balance and randomization in psychology experiments that are created in Labvanced are handled by multiple parts and features across the platform, such as with the:

    Multiple Tasks & Blocks

    • Study Design Tab: When a study is opened, the Study Design tab is where you can add randomization separators (see image below, the thick black line) to indicate which blocks and sessions should be randomized.

    Stimuli WITHIN a Single Task / Trial

    • Factors (Trial System): Using factors in the Trial System, a block design can be created for your experiment. You can subsequently specify which factors should be fixed or random.
    • Task Editor Randomization Settings: This dialog box (image above) demonstrates the type of randomization settings you can specify while creating a task. You can also indicate that the trials within each task should be balanced.
    • Data Frames: Data frames can be used to set up and create a study, but they also be applied to ensure randomization in experiments. Data frames hold stimuli similar to an array and can be used in a variety of events.
    • The Events System: Sometimes randomization in psychology experimental research requires you to counter variables or index arrays. The Events System allows you to create triggers/actions so that arrays are shuffled (rearranging the values in a random order), countering variables (fetching a value for each trial), and subsequently pulling the value from the data frame.

    Adding Randomization Separators in the Study Design Tab for Blocks and Sessions

    Adding Randomization Separators in the Study Design Tab for Blocks and Sessions

    In order to ensure your experiment is appropriately balanced and randomized, you will most likely utilize data frames in combination with events. It is also possible to utilize factors (the Trial System). By working with the features described above, you can ensure integrity in your experimental design.

    If you have any questions about how to handle randomization in your experiments, please contact us!

    For practical design-pattern guides covering how to apply these tools to common research scenarios, see Experiment Design.

    Next
    Eye Tracking