UX-UI Designer Expert

📍 Job Overview

Job Title: UI/UX Design Expert

Company: Sojistudio

Location: United States

Job Type: CONTRACTOR

Category: Design Operations / AI Evaluation

Date Posted: 2026-07-29

Experience Level: 5-10 Years

Remote Status: Fully Remote

🚀 Role Summary

• Evaluate the performance of AI systems in executing real-world digital product design tasks, focusing on criteria definition and scoring.

• Develop precise, task-specific grading criteria for a variety of digital product deliverables, ensuring reproducibility and defensibility of evaluations.

• Provide rigorous, well-reasoned written justifications for scoring completed work samples, demonstrating exceptional written communication skills.

• Collaborate with senior reviewers to incorporate feedback and iterate on evaluation methodologies, ensuring consistent application of judgment.

• Act as an independent contractor with flexible scheduling, contributing expertise to a leading AI research organization.

📝 Enhancement Note: This role is unique in that it focuses on the evaluation of AI-generated design work rather than direct design execution. The emphasis on defining grading criteria and providing detailed justifications positions this as a "Design Operations" or "AI Evaluation" role within the broader design and technology landscape. The target audience for this role is experienced design professionals who can apply their craft to assess and calibrate AI output.

📈 Primary Responsibilities

• Design and document precise, task-specific grading criteria for a wide range of digital product and UX deliverables, including:

  • Design systems and component libraries
  • Responsive UI layouts and dashboards
  • End-to-end product flows (e.g., onboarding, checkout, booking)
  • Logged-in customer portals
  • UX writing and product content
  • Design-to-engineering/production handoff

• Evaluate AI-generated and human-created work samples against established criteria, providing detailed, evidence-based written justifications for each score.

• Apply consistent, objective, and reproducible judgment to ensure the defensibility of all evaluations.

• Integrate structured feedback from senior reviewers, iterating quickly on scoring and criteria to achieve calibration and maintain high standards.

• Articulate critique and provide clear rationale that mirrors the judgment of a design or UX lead in a professional review setting.

📝 Enhancement Note: The responsibilities highlight a critical need for structured evaluation processes within AI development for design. The emphasis on specific deliverable types (design systems, product flows, UX writing) indicates a need for broad design experience. The requirement for detailed written justifications points to a strong analytical and communication component, crucial for AI model training and calibration.

🎓 Skills & Qualifications

Education: While no specific degree is mandated, a strong portfolio and demonstrated expertise in product design, UI/UX, or design systems are paramount, often achieved through formal education in design, HCI, or related fields, or through extensive self-study and practical experience.

Experience: 5+ years of professional experience in product design, UI/UX, or design systems for real digital products (excluding brand or marketing sites).

Required Skills:

• Deep fluency in the practical aspects of product design: interaction design, visual design, design systems, responsive layouts, and end-to-end product flows.

• Proficiency with industry-standard design tools, particularly Figma, for prototyping and production handoff.

• Exceptional written communication skills, with the ability to clearly articulate design rationale, critique, and justification.

• Detail-oriented with a commitment to consistency and accuracy in evaluation.

• Ability to apply evidence-based judgment and have one's assessments reviewed and calibrated against peers.

• Experience working in fast-paced environments with structured feedback loops. Preferred Skills:

• Background at leading digital-product studios, in-house product-design teams at major product-led companies, or e-commerce/marketplace companies with sophisticated customer portals and dashboards.

• Experience across specific tracks such as: Product/UI Designer, Design Systems Designer, UX Lead, UX Writer/Content Designer, or Digital Product/Business Analyst.

• Prior experience with AI training, evaluation, or human-data projects.

📝 Enhancement Note: The emphasis on "real digital products" and specific experience backgrounds (product-led companies, e-commerce) suggests the evaluation criteria will be grounded in practical, user-centric design principles and business outcomes, rather than purely aesthetic considerations. The preference for AI training/evaluation experience is a significant plus, indicating the organization values candidates who understand the intersection of design and AI development.

📊 Process & Systems Portfolio Requirements

Portfolio Essentials:

• Showcase a comprehensive range of digital product design projects, clearly demonstrating expertise in UI/UX, product flows, and design systems.

• Include case studies that detail the design process from problem definition to solution implementation, highlighting interaction design, visual design, and user-centered decision-making.

• Demonstrate proficiency in Figma or similar tools, with examples of complex prototypes, component libraries, or design system documentation.

• Present clear examples of responsive UI layouts and dashboards, illustrating adaptability across different screen sizes and contexts.

• Feature work on end-to-end product flows (e.g., onboarding, checkout, customer portals), detailing user journeys and interaction logic.

• Include examples of UX writing or product content if applicable to your background.

• Provide evidence of experience with design-to-engineering/production handoff processes. Process Documentation:

• For each portfolio piece, clearly articulate the specific problem statement, your role, the design process followed, and the rationale behind key design decisions.

• Detail how user feedback or data was incorporated into the design process and evaluation.

• Explain how design systems or reusable components were leveraged to ensure consistency and efficiency in your projects.

• Document the approach taken for design-to-engineering handoff, including any specific tools or methods used to ensure accurate implementation.

📝 Enhancement Note: The portfolio requirement is critical for this role, as it serves as the primary evidence of a candidate's ability to define and apply rigorous design standards. The emphasis is on demonstrating deep, practical experience and the ability to articulate design decisions and processes, which will directly translate to their ability to evaluate AI output against these same high standards. The request for "design-to-engineering/production handoff" suggests the evaluation criteria will extend to technical feasibility and implementation accuracy.

💵 Compensation & Benefits

Salary Range: $80 - $150 per hour. This range reflects the "Expert" level of the role, requiring significant professional experience and specialized skills in UI/UX design and evaluation. The upper end of the range is for candidates with extensive experience, a strong track record in high-impact product design, and potentially prior AI evaluation experience.

Benefits:

• Independent contractor status, offering flexibility and autonomy.

• Flexible commitment and own schedule, allowing for work-life integration.

• Potential for project extensions based on performance and organizational needs.

• Weekly payments via Stripe or Wise for timely compensation.

• Opportunity to work remotely from anywhere in the United States.

Working Hours: Flexible commitment, allowing the contractor to set their own schedule. While the role requires a significant commitment to detailed evaluation, the hours are not strictly fixed, accommodating the contractor's availability. The expected workload will depend on project needs and individual performance.

📝 Enhancement Note: The compensation range is indicative of senior-level expertise and specialized skills in demand. The benefits listed are typical for independent contractor roles, emphasizing flexibility and autonomy. The "flexible commitment" suggests that while the role is substantial, the contractor can manage their time, aligning with the need for focused, detailed work on evaluation tasks.

🎯 Team & Company Context

🏢 Company Culture

Industry: Technology (AI Research, Software Development). Sojistudio is partnering with a leading AI research organization, placing this role at the forefront of AI development and its application to creative and technical fields. The environment is likely to be highly analytical, data-driven, and focused on innovation.

Company Size: Not explicitly stated, but partnering with a "leading AI research organization" suggests a dynamic, potentially fast-paced environment that values specialized expertise. The engagement model as an independent contractor implies a focus on project-based contributions rather than traditional full-time employment structures.

Founded: Not specified. The focus is on the current project and the partner organization's AI research capabilities.

Team Structure:

• The role operates as an independent contractor, meaning direct integration into a traditional internal team structure may be limited.

• Collaboration will primarily be with senior reviewers and potentially project managers within the AI research organization.

• Cross-functional collaboration is implicit, as the evaluations will inform AI development teams, product teams, and potentially researchers focused on AI capabilities in design.

• The contractor will work independently but be part of a broader evaluation effort, likely with other expert designers. Methodology:

• Data-driven evaluation: Scores and justifications must be evidence-based and reproducible.

• Rigorous calibration: Judgment will be reviewed and aligned with peers to ensure consistency and defensibility.

• Iterative improvement: Feedback from senior reviewers will be used to refine evaluation criteria and scoring.

• Focus on craft: Deep understanding and application of professional design practices are essential for effective evaluation.

Company Website: https://www.hiring.sojistudio.com

📝 Enhancement Note: The company culture is likely to be highly specialized, demanding, and focused on objective, data-driven outcomes. As an independent contractor, the individual will need to be self-motivated and adept at working with structured feedback and calibration processes, which are crucial for AI model development. The emphasis on "leading AI research organization" implies a cutting-edge environment.

📈 Career & Growth Analysis

Operations Career Level: Expert Evaluator / Senior Design Consultant. This role is positioned at a senior level, requiring extensive practical experience and the ability to apply expert judgment rather than simply executing design tasks. It's an opportunity to leverage deep design knowledge in a novel application area – AI evaluation.

Reporting Structure: As an independent contractor, the reporting structure will be project-based. The UI/UX Design Expert will report to project leads or senior reviewers within the AI research organization, receiving direction and feedback on their evaluation tasks.

Operations Impact: The impact of this role is significant. By defining precise grading criteria and providing rigorous evaluations, the expert directly influences the accuracy, quality, and real-world applicability of AI systems designed to perform digital product design tasks. This feedback loop is critical for the advancement of AI in creative industries.

Growth Opportunities:

• Specialization in AI Evaluation for Design: Develop a niche expertise at the intersection of design and artificial intelligence, a rapidly growing field.

• Contribution to Cutting-Edge AI Research: Gain insights into the development of AI models for creative tasks and contribute to their refinement.

• Expanded Project Opportunities: Successful performance may lead to longer contracts or engagements on other AI evaluation projects within the organization or its partners.

• Skill Refinement: Sharpen critical thinking, analytical skills, and the ability to articulate complex design concepts and critiques with extreme clarity.

📝 Enhancement Note: This role offers a unique growth path for experienced designers into the burgeoning field of AI evaluation. It's less about traditional career progression within a design team and more about becoming an expert in a specialized, high-demand area that bridges design craft with AI development. The "growth" here is in specialized knowledge and influence rather than hierarchical advancement.

🌐 Work Environment

Office Type: Fully Remote. This role is entirely digital and does not require physical presence in an office.

Office Location(s): United States. While the role is remote, candidates must be legally authorized to work in the United States.

Workspace Context:

• Independent work environment: Requires a dedicated, distraction-free space conducive to detailed analytical work and writing.

• Digital collaboration tools: Heavy reliance on communication platforms (e.g., Slack, email) and potentially project management software for task assignment and feedback.

• Access to design tools: Requires personal access to and proficiency with Figma or similar design software for reviewing deliverables.

• Flexible schedule: The contractor manages their own time to meet project deadlines and evaluation targets, allowing for integration with personal life.

Work Schedule: Flexible commitment, own schedule. The contractor is expected to dedicate the necessary time to complete assigned evaluations thoroughly and on time, but the hours are not fixed. This requires strong self-discipline and time management.

📝 Enhancement Note: The remote, flexible nature of this role is a key attraction for experienced professionals seeking autonomy. However, it necessitates a high degree of self-motivation, discipline, and effective time management to meet the rigorous demands of AI evaluation. The "workspace context" emphasizes the need for a professional setup that supports focused, analytical work.

📄 Application & Portfolio Review Process

Interview Process:

• Initial Application Review: Submission of resume and portfolio/professional background. Focus will be on the depth and breadth of design experience, particularly in areas relevant to the deliverables to be evaluated.

• Portfolio/Background Assessment: A detailed review of submitted materials to gauge expertise, clarity of communication, and alignment with required qualifications.

• Potential Assessment/Information Request: Qualified candidates may be asked to complete a brief assessment (e.g., evaluating a design sample, writing a critique) or provide additional information to further evaluate their judgment and communication skills.

• Final Evaluation: Based on all submitted materials and any assessments, candidates will be selected. The process emphasizes rigorous evaluation of the candidate's ability to evaluate others.

Portfolio Review Tips:

• Curate Strategically: Select projects that best showcase your expertise in the specific deliverables mentioned (design systems, product flows, UI layouts, UX writing, etc.).

• Highlight Process & Rationale: For each project, clearly explain the problem, your role, the design process, and why you made certain design decisions. This demonstrates your critical thinking.

• Demonstrate Tool Proficiency: Ensure your portfolio visually represents your skill in tools like Figma, showcasing complex prototypes or detailed design system components.

• Showcase Written Communication: If possible, include examples of written design documentation, project summaries, or even client communication that highlights your ability to articulate design concepts clearly and concisely. This is crucial for this role.

• Focus on Real-World Impact: Emphasize how your designs addressed user needs and business objectives for actual digital products.

Challenge Preparation:

• Understand Evaluation Metrics: Familiarize yourself with common UX/UI evaluation frameworks and metrics. Think about how you would objectively assess design quality.

• Practice Articulating Critique: Mentally (or in writing) critique existing digital products, focusing on specific details of interaction, visual design, and user flow. Practice explaining why something works or doesn't work for the user.

• Review AI/ML Concepts (Optional but helpful): While not strictly required, a basic understanding of how AI models learn and are trained can provide context for the evaluation process.

• Prepare for Calibration: Be ready to discuss how you ensure consistency in your judgment and how you would handle feedback if your evaluations differed from a senior reviewer's.

📝 Enhancement Note: The application process is designed to mirror the role itself – it's about evaluating the candidate's evaluative capabilities. The portfolio is not just a showcase of design work but a demonstration of the candidate's ability to think critically, communicate effectively, and apply rigorous standards. The "challenge preparation" focuses on developing the mindset of an evaluator.

🛠 Tools & Technology Stack

Primary Tools:

• Figma: Essential for reviewing and potentially creating examples of design deliverables. Proficiency in advanced features like prototyping, component libraries, and design system management is key.

• Communication Platforms: Tools like Slack, Microsoft Teams, email, or similar for communication with project leads and reviewers.

• Project Management Software: Potentially used for task assignment, progress tracking, and feedback delivery (e.g., Asana, Jira, Trello, or proprietary systems).

Analytics & Reporting:

• Spreadsheet Software (e.g., Excel, Google Sheets): For organizing scores, justifications, and potentially tracking project progress.

• Word Processing Software (e.g., Google Docs, Microsoft Word): Critical for writing detailed justifications and documentation.

CRM & Automation:

• Not directly applicable to the core design evaluation tasks, but understanding how design systems integrate with development workflows is beneficial.

• AI/ML Platforms (Familiarity): While not a direct tool requirement, understanding the context of AI model training and evaluation platforms would be advantageous for comprehending the broader project.

📝 Enhancement Note: The technology stack is relatively standard for design professionals, with a strong emphasis on Figma. The "analytics & reporting" section highlights the importance of strong written and organizational skills, as the output of this role is primarily documented evaluations and justifications. The mention of AI/ML platforms is more about understanding the context than direct operational use.

👥 Team Culture & Values

Operations Values:

• Excellence in Craft: A deep commitment to high-quality, professional design execution and evaluation.

• Objectivity and Rigor: A dedication to applying consistent, evidence-based judgment, free from personal bias.

• Clarity and Precision: Valuing clear, concise, and well-reasoned communication in all feedback and documentation.

• Continuous Improvement: Embracing feedback and calibration as opportunities to refine skills and ensure consistent application of standards.

• Data-Driven Decision Making: Basing evaluations on observable criteria and demonstrable outcomes.

Collaboration Style:

• Independent Contribution with Structured Feedback: While the work is largely independent, collaboration is essential through receiving structured feedback from senior reviewers and participating in calibration sessions.

• Professional Skepticism and Constructive Critique: An environment where design decisions are openly discussed, and critique is provided constructively to improve AI output.

• Knowledge Sharing (Implicit): Contributing to the collective understanding of AI capabilities in design through your evaluations and justifications.

📝 Enhancement Note: The culture values analytical rigor, precise communication, and a commitment to professional standards. For an independent contractor, this means being highly self-directed but also responsive to structured feedback and calibration processes essential for AI development. The emphasis is on objective evaluation and clear articulation of design principles.

⚡ Challenges & Growth Opportunities

Challenges:

• Subjectivity vs. Objectivity: Balancing the inherent subjectivity of design with the need for objective, reproducible evaluation criteria for AI.

• Scale of Evaluation: Potentially evaluating a high volume of AI-generated work samples, requiring efficiency and sustained focus.

• Calibrating Judgment: Ensuring consistent application of criteria across different work samples and over time, especially when compared against peer evaluations.

• Communicating Complex Critiques: Articulating nuanced design flaws or strengths in a way that is clear, actionable, and defensible to AI developers.

Learning & Development Opportunities:

• Deep Dive into AI Model Training: Gaining practical experience in how human expertise is translated into training data for AI models in creative fields.

• Developing Expertise in AI Evaluation Frameworks: Becoming proficient in specialized methods for assessing AI-generated creative output.

• Understanding the AI Design Frontier: Staying at the cutting edge of AI's capabilities and limitations in digital product design.

• Refining Communication Skills: Enhancing the ability to articulate complex technical and creative judgments with exceptional clarity and precision.

📝 Enhancement Note: The challenges are directly related to the novelty of the role and the complexities of evaluating AI. The growth opportunities are significant and focused on building specialized expertise in a highly sought-after intersection of design and AI.

💡 Interview Preparation

Strategy Questions:

• "Describe a time you had to define objective criteria for evaluating design work. What were the challenges, and how did you overcome them?" (Focus on process, objectivity, and problem-solving).

• "How would you approach evaluating an AI-generated onboarding flow for a new mobile application? What specific criteria would you prioritize?" (Assess ability to apply design principles to a specific task).

• "Imagine a senior reviewer disagrees with your score for a particular design sample. How would you handle that situation to reach a consensus or justify your evaluation?" (Gauge collaboration, communication, and calibration skills). Company & Culture Questions:

• "What interests you about evaluating AI-generated design work, as opposed to creating it?" (Understand motivation and alignment with the role's purpose).

• "How do you maintain consistency and objectivity in your design critiques, especially when dealing with subjective elements?" (Assess self-awareness and methodology for objectivity).

• "Given your experience, what do you believe are the most critical aspects of a 'real-world' digital product design that an AI should be able to replicate?" (Gauge understanding of practical design standards). Portfolio Presentation Strategy:

• Structure for Clarity: Organize your portfolio around key deliverables and projects. For each, clearly outline the problem, your role, the process, and the outcome/impact.

• Emphasize Rationale: For every design decision explained, articulate the why behind it. This demonstrates critical thinking and your ability to justify choices, which is key to evaluating AI.

• Showcase Written Communication: If possible, verbally walk through a project's documentation, or highlight written summaries that demonstrate your ability to communicate complex ideas clearly.

• Highlight Evaluation Mindset: Frame your project walkthroughs not just as "what I designed" but as "how I approached the problem and why this solution is effective for users and business goals." This implicitly showcases your evaluative capabilities.

📝 Enhancement Note: Interview preparation should focus on demonstrating analytical thinking, strong communication, and a deep understanding of design principles that can be translated into objective evaluation criteria. Candidates should be ready to discuss their process for critical assessment and their ability to articulate nuanced feedback.

📌 Application Steps

To apply for this operations position:

• Submit your resume, portfolio, or relevant professional background through the application link provided by Sojistudio.

• Curate Your Portfolio for Evaluation: Tailor your portfolio to highlight projects demonstrating expertise in the specific deliverables mentioned in the job description (design systems, product flows, UX writing, etc.). Emphasize case studies that detail your design process and rationale, showcasing your ability to think critically.

• Optimize Your Resume for Keywords: Ensure your resume includes keywords such as "UI/UX Design," "Product Design," "Design Systems," "Figma," "UX Writing," "Interaction Design," "Visual Design," "AI Evaluation," and "Critical Thinking," aligning with the role's requirements. Highlight quantifiable achievements where possible.

• Prepare for a Written Assessment: Be ready to complete a brief assessment that may involve evaluating design samples or articulating critiques, mirroring the core responsibilities of the role. Practice writing clear, concise, and evidence-based justifications.

• Research the Partner Organization: While Sojistudio is the hiring partner, understanding the focus of the "leading AI research organization" can provide context for the types of design challenges the AI is being trained to address.

⚠️ Important Notice: This enhanced job description includes AI-generated insights and operations industry-standard assumptions. All details should be verified directly with the hiring organization before making application decisions.