Probably the rubber, which is less dense, will contract first. That would make sense!
But in an old lever where the piston has seized it might not contract enough.
Get some bleed pipe or an old bit of hose, cram it in a pump, foot pump will do, and use that now, whilst it's cold.