← Back to Paper Radar

Portal UX Agent - A Plug-and-Play Engine for Rendering UIs from Natural Language Specifications

Xinsong Li, Ning Jiang, Jay Selvaraj
arXiv.org | 2025
Portal UX Agent constrains LLM-driven UI generation to high-level planning. The LLM emits a schema-typed composition of templates and components, and a deterministic renderer assembles the interface from a vetted design-system library. This trades some expressiveness for reliability, security, and auditability.

Problem Statement

LLMs that generate free-form UI code are expressive but often produce insecure, buggy, or off-brand interfaces that are hard to govern in enterprise settings. Static UIs are safe and compliant but cannot adapt to user intent. Practitioners lack a principled middle ground, and they also lack a standard way to evaluate generated UIs beyond ad hoc inspection.

Key Novelty

  • A bounded-generation architecture that separates LLM planning (intent to typed composition-template and component specification) from deterministic rendering over a vetted component library.
  • A schema-constrained intermediate representation for UIs that supports auditability, reuse, and plug-and-play renderers while keeping flexibility.
  • A mixed-methods evaluation framework that combines automatic checks (component coverage, property fidelity, layout validity, accessibility, performance) with an LLM-as-a-Judge rubric for semantic alignment and visual polish.

Evaluation Highlights

  • On multi-domain portal scenarios, the agent reportedly turns natural-language intent into coherent, usable UIs, according to automatic checks and LLM-judge scores.
  • It is reported to perform well on compositionality and clarity. The abstract gives no quantitative numbers or explicit baseline comparisons (e.g., against free-form code generation).

Signal Assessment

4/10 The work is a sound engineering synthesis of familiar ideas: structured or constrained LLM outputs, design-system rendering, and LLM-as-a-Judge evaluation, applied to UI generation. It is practically valuable for enterprise portals but conceptually incremental, and from the abstract its evaluation appears limited in quantitative rigor and baseline comparison.

Methodology

  1. Define a vetted library of design-system components and layout (composition) templates, plus a typed schema describing their properties and valid compositions.
  2. Prompt an LLM to interpret the user's natural-language intent and emit a schema-constrained plan: a composition template selection and component specifications with properties.
  3. Validate the plan against the schema; a deterministic renderer then assembles the final UI from the vetted components, so no arbitrary code is executed.
  4. Evaluate the generated UIs with automatic metrics (coverage, property fidelity, layout correctness, accessibility, performance).
  5. Complement these with an LLM-as-a-Judge rubric scoring semantic alignment with intent and visual polish across multi-domain portal scenarios.

System Components

LLM Planner

Maps natural-language intent to a high-level UI plan, selecting templates and specifying components and their properties.

Typed Schema / Intermediate Representation

Constrains LLM output to valid composition-template and component specifications, enabling validation, auditing, and reuse.

Vetted Component and Template Library

A design-system-compliant set of UI components and layout templates that bounds what can be rendered.

Deterministic Renderer

A plug-and-play engine that assembles the final UI from the validated specification without free-form code generation, ensuring safety and consistency.

Automatic Evaluation Suite

Checks component coverage, property fidelity, layout validity, accessibility compliance, and rendering performance.

LLM-as-a-Judge Rubric

Scores semantic alignment between intent and rendered UI, as well as visual polish and clarity.

Results

Metric/Benchmark Baseline This Paper Delta
Intent-to-UI coherence (multi-domain portals) Not reported in abstract Reliably coherent, usable UIs Qualitative improvement claimed
Compositionality (LLM-judge) Not reported in abstract Strong Qualitative
Clarity (LLM-judge) Not reported in abstract Strong Qualitative
Design-system compliance / safety Free-form codegen: weaker by design Compliant by construction (vetted components) Structural advantage
Automatic checks (coverage, fidelity, layout, a11y, performance) Not reported in abstract Reported as performing well Qualitative

Key Takeaways

  • For production UI generation, let the LLM emit a typed, schema-validated plan over a vetted component library rather than raw code. This greatly improves security, consistency, and auditability with modest loss of expressiveness.
  • Separating planning from deterministic rendering makes renderers swappable (plug-and-play across frameworks or design systems) and makes failures easier to debug at the specification level.
  • Evaluate generative UI agents with both programmatic checks (accessibility, layout, property fidelity) and LLM-as-a-Judge rubrics for subjective qualities, but calibrate judge scores against human ratings before trusting them.

Abstract

The rapid appearance of large language models (LLMs) has led to systems that turn natural-language intent into real user interfaces (UIs). Free-form code generation maximizes expressiveness but often hurts reliability, security, and design-system compliance. In contrast, fully static UIs are easy to govern but lack adaptability. We present the Portal UX Agent, a practical middle way that makes bounded generation work: an LLM plans the UI at a high level, and a deterministic renderer assembles the final interface from a vetted set of components and layout templates. The agent maps intents to a typed composition-template and component specifications-constrained by a schema. This enables auditability, reuse, and safety while preserving flexibility. We also introduce a mixed-methods evaluation framework that combines automatic checks (coverage, property fidelity, layout, accessibility, performance) with an LLM-as-a-Judge rubric to assess semantic alignment and visual polish. Experiments on multi-domain portal scenarios show that the Portal UX Agent reliably turns intent into coherent, usable UIs and performs well on compositionality and clarity. This work advances agentic UI design by combining model-driven representations, plug-and-play rendering, and structured evaluation, paving the way for controllable and trustworthy UI generation.

Generated automatically from available metadata and abstract on 2026-11-09.