I am sure that there are many internet provider services accept both computers. A router device would be fine (it connects two computers). I would rather for you to check the info before you pay your ISP service because some tech supports never response back because they did not have the resource - I think it is a dirty business.
My Verizon Company provides a DSL service, and I still use it. I found out that it is a third party company, and they won't tell me a name of the company because it does not have a tech support e-mail address. It only gives me a phone number. I hate an automatic voice machine asking me several options for the departments. You know what I mean.