Randaugment for ViT

RandAugment is the simplified augmentation search that randomly applies a fixed number of transformations with a single global magnitude, eliminating per-operation tuning — it empowers Vision Transformers with a wide diversity of distortions while keeping the augmentation pipeline lightweight.

What Is RandAugment?

• Definition: A data augmentation policy that randomly selects N transformations from a predefined set and applies each with uniform magnitude M drawn from a single global schedule.
• Key Feature 1: No reinforcement learning search is required; only N and M are tuned via grid search or heuristics.
• Key Feature 2: Transformation pool includes rotations, shears, color adjustments, and Cutout operations, so each training batch exposes the model to varied stimuli.
• Key Feature 3: The same policy works across datasets, so it is portable across ViT, Swin, and CNN backbones.
• Key Feature 4: Works with token labeling because deterministic transformation sets keep patch alignments consistent.

Why RandAugment Matters

• Simplicity: Removes the need for expensive augmentation search while retaining the benefits of diverse policies.
• Generality: A single set of parameters often transfers from ImageNet to fine-grained or medical datasets.
• Regularization: Randomized intensity prevents memorization without altering network architecture.
• Efficiency: Minimal overhead compared to AutoAugment and learned policies.
• Compatibility: Plays well with mixup, CutMix, and patch dropout for multi-pronged regularization.

Policy Parameters

N (Transforms Per Image):
- Typically 2 or 3 in ViT training; more transforms increase difficulty but also blur semantics.

M (Magnitude):
- Controls strength of each transform; can be ramped up slowly across epochs for curriculum.

Transform Pool:
- Includes geometric, color, and patch-level operations; customizable per dataset.

How It Works / Technical Details

Step 1: For every image, randomly choose N augmentation operations from a pool, each applied with magnitude M (e.g., rotate 15 degrees, shear 0.3, color adjust 0.4).

Step 2: Apply transforms sequentially to create the augmented image, feed the patch grid to the ViT, and compute loss; because operations are stochastic there is no deterministic augmentation schedule.

Comparison / Alternatives

Tools & Platforms

• Albumentations / torchvision: Implement RandAugment pipelines ready for ViT feeders.
• timm: Supports RandAugment via config entries like `rand_augment_magnitude`.
• Scaling Tools: Hydra or Ookla-s scheduler to vary N and M over epochs.
• Monitoring: Keep track of transformation distributions to avoid degenerate mixes.

RandAugment is the lightweight augmentation engine that keeps ViTs honest without requiring a heavy search — it seeds batches with random distortions so the model sees a broad slice of visual patterns every epoch.