The wild yellow birds of Pennsylvania are mostly warblers, tanagers, and orioles. Sometimes they are the females of a species that look different from the males. The most well-known bird of the state is the American goldfinch, a small yellow bird with black wings. The yellow warbler is a bright yellow bird of Pennsylvania, while the yellow-breasted chat, as the name suggests, is a songbird with a yellow belly.