To defend Wildberger a bit (because I am an ultrafinitist) I'd like to state first that Wildberger has poor personal PR ability.
Now, as programmers here, you are all natural ultrafinitists as you work with finite quantities (computer systems) and use numerical methods to accurately approximate real numbers.
An ultrafinitist says that that's really all there is to it. The extra axiomatic fluff about infinities existing are logically unnecessary to do all the heavy lifting of the math that we are familiar with. Wildberger's point (and the point of all ultrafinitist claims) is that it's an intellectual and pedagogical disservice to teach and speak of, e.g. Real Numbers, as if they're actually involving infinite quantities that you can never fully specify. We are always going to have to confront the numerical methods part, so it's better to make teaching about numbers methodologically aligned with how we actually measure and use them.
I have personally been working on building various finite equivalents to familiar math. I recommend anyone to read Radically Elementary Probability Theory by Nelson to get a better sense of how to do finite math, at least at the theoretical level. Once again, on a practical level to do with directly computing quantities, we've only ever done finite math.
Topology, i.e. the analysis of connectivity, is built upon the notion of continuity and infinite divisibility, which seems to be difficult to handle in an ultrafinitist way.
Topology is an exceedingly important branch of mathematics, not only theoretically (I consider some of the results of topology as very beautiful) but also practically, as a great part of the engineering design work is for solving problems where only the topology matters, not the geometry, e.g. in electronic schematics design work.
So I would consider any framework for mathematics that does not handle well topology as incomplete and unusable.
Ultrafinitist theories may be interesting to study as an alternative, but the reality is that infinitesimal calculus in its modern rigorous form does not need any alternatives, because it works well enough and until now I have not seen alternatives that are simpler, but only alternatives that are more complicated, without benefits sufficient to justify that.
I also wonder what ultrafinitists do about projective geometry and inversive geometry.
I consider projective geometry as one of the most beautiful parts of mathematics. When I encountered it for the first time when very young, it was quite a revelation, due to the unification that it allows for various concepts that are distinct in classic geometry. The projective geometry is based on completing the affine spaces with various kinds of subspaces located at an "infinite" distance.
Without handling infinities, and without visualizing how various curves located at infinity look like (as parts of surfaces that can be seen at finite distances), projective geometry would become very hard to understand, even if one would duplicate its algorithms while avoiding the names related to "infinity".
Similarly for inversive geometry, where the affine spaces are completed with points located at "inifinity".
Such geometries are beautiful and very useful, so I would not consider as usable a variant of mathematics where they are not included.
The error of Zeno of Elea was that he did not understand the symmetry between zero and infinity (or he pretended to not understand it).
Because of this error, Zeno considered that infinity is stronger than zero, so he believed or pretended to believe that zero times infinity is infinity, instead of recognizing that zero times infinity can be any number and also zero or infinity.
For now, there exists no evidence whatsoever that the physical space and time are not infinitely divisible.
Even if in the future it would be discovered that space and time have a discrete structure, the mathematical model of an infinitely divisible space and time would remain useful as an approximation, because it certainly is simpler than whatever mathematical model would be needed for a discrete space and time.