Only in the most perfect conditions can a deaf person lipread more or less effortlessly - those conditions are: the speaker is directly in front of you, not walking around or looking away, not wearing sunglasses or a heavy beard, is in good lighting, no distracting background noise and they are moving their lips clearly.
In reality, we don't have all those perfect setups for effortless lipreading so it's actually pretty labourious most of the time. Especially for those with severe to profound hearing loss.
Whomever told you all deaf people need is lipreading, not ASL, tell them us deaf people say "wrong-o!"