In the long run, yes, everything derived from fossil fuel is finite in supply.

In the short to medium run, you'd be surprised how long scavengers can keep things going at a piss-poor level of development.

Examples: much of Africa. I'm not joking. They have gas thieves and road bandits. Some of those countries have basically been in ruins for decades.