In style.css, change

.site-tagline {
    margin-top: 0;
}

to

.home .site-tagline {
    margin-top: 0;
}