Very far from the airport its takes 6 hours to reach yogakarta airport. The trips are tiring if you realy like kampung style Cilacap are good otherwise once you visit I don't thing that you want to go again.
Cilacap is better than Yogakarta in term of inviorement those who like kampung and padi fields that the place you can visit but very tiring because 6 hours travel by car or bus from the airport.
While you were in Cilacap try the Hin Shin sea food restaurant good food at valuable price. Don't forget to have a tour to Nusakambangan prison islaind.
When I was studying in high school Cilacap was hot. Now this town is really green and shaded. In the evening Cilacap more beautiful.