
GATE exam assesses engineering and science undergraduate subjects for postgraduate admissions in India
Image: Meta AI, Public domain, via Wikimedia Commons
GATE exam assesses engineering and science undergraduate subjects for postgraduate admissions in India
The Graduate Aptitude Test in Engineering (GATE) is an entrance examination for Indian students pursuing postgraduate programs in engineering and sciences. It is conducted by the Indian Institute of Science and seven Indian Institutes of Technology across various cities in India. The GATE score determines the candidate's eligibility for admission to these programs.
Example
A student scoring well in the GATE exam may gain admission to a prestigious Master of Engineering program at an Indian Institute of Technology.
Understanding the GATE exam's significance helps students prepare effectively for competitive postgraduate admissions.
GAT (Graph Attention Network) adds: learned attention weights between neighbors
GAT adds learned attention weights between neighbors, enhancing node feature aggregation
MoE models have more parameters but similar compute cost
MoE models distribute parameters across k experts, reducing active experts' compute cost
Mixture of experts
Mixture of experts (MoE) divides problem space into homogeneous regions
Knowledge distillation
Knowledge distillation transfers knowledge from a large model to a smaller one without loss of validity
load balancing loss is needed in MoE
Load balancing loss in MoE prevents expert collapse by distributing workload evenly across experts
weight initialization matters: Xavier/He init keeps activation variance ≈ 1 across layers
Weight initialization stabilizes learning by maintaining consistent activation variance
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews