https://github.com/ultrafunkamsterdam/undetected-chromedriver
Optimized Selenium Chromedriver patch which does not trigger anti-bot services like Distill Network / Imperva / DataDome / Botprotect.io Automatically downloads the driver binary and patches it.
pip install undetected-chromedriver
or , if you're feeling adventurous, install directly via github
pip install git+https://www.github.com/ultrafunkamsterdam/undetected-chromedriver@master # replace @master with @branchname for other branches
I will be putting limits on the issue tracker. It has beeen abused too long.
any good news?
Yes, i've opened Undetected-Discussions which i think will help us better in the long run.
THIS PACKAGE DOES NOT, and i repeat DOES NOT hide your IP address, so when running from a datacenter (even smaller ones), chances are large you will not pass! Also, if your ip reputation at home is low, you won't pass!
Running following code from home , and from a datacenter.
import undetected_chromedriver as uc
driver = uc.Chrome(headless=True,use_subprocess=False)
driver.get('https://nowsecure.nl')
driver.save_screenshot('nowsecure.png')
Big update! be careful as it -potentially- could break your code.
rewritten the anti-detection mechanism instead of removing and renaming variables, we just keep them, but prevent them from being injected in the first place. This will keep us safe from detection at least for the near future.
rewritten the file naming, to prevent ending up with 1000 of {randomstring}_chromedriver.exe 's instead it is just called undetected_chromedriver.exe
cleanup removed compat,v2 files and tests folder
added WebElement.click_safe() method, which you can try in case you get detected after clicking a link. This is not guaranteed t o work.
added WebElement.children(self, tag=None, recursive=False) to easily get/find child nodes. example:
body = driver.find_element('tag name', 'body')
# get the 6th child (any tag) of body, and grab all img's within (recursive).
images = body.children()[6].children('img', True)
srcs = list(map(lambda _:_.attrs.get('src'), images))
added example.py where i can point people at when asking silly questions (no, its actually quite cool, everyone should see it)
added support for lambda platform
added support for x86_32
added support for systems reporting as linux2
some refactoring
use_subprocess now defaults to True. too many people don't understand multiprocessing and name == 'main, and after testing, it seems not to make a difference anymore in chrome 104+
added no_sandbox, which defaults to True, and this without the annoying "you are using unsecure command line ..." bar.
update Docker image. you can now vnc or rdp into your container to see the actual browser window
of course, "regular" mode works as well
this version might break your code, test before update!
added new anti-detection logic!
v2 has become the main module, so no need for references to v2 anymore. this mean you can now simply use:
import undetected_chromedriver as uc
driver = uc.Chrome()
driver.get('https://nowsecure.nl')for backwards compatibility, v2 is not removed, but aliassed to the main module.
Fixed "welcome screen" nagging on non-windows OS-es. For those nagfetishists who ❤ welcome screens and feeding google with even more data, use Chrome(suppress_welcome=False).
replaced executable_path in constructor in favor of browser_executable_path
which should not be used unless you are the edge case (yep, you are) who can't add your custom chrome installation folder to your PATH
environment variable, or have an army of different browsers/versions and automatic lookup returns the wrong browser
"v1" (?) moved to _compat for now.
fixed dependency versions
ChromeOptions custom handling removed, so it is compatible with webdriver.chromium.options.ChromiumOptions.
removed Chrome.get() fu and restored back to "almost" original:
with statements needed anymore, although it will still work for the sake of backward-compatibility.test success to date: 100%
just to mention it another time, since some people have hard time reading: headless is still WIP. Raising issues is needless
change process creation behavior to be fully detached
changed .get(url) method to always use the contextmanager
changed .get(url) method to use cdp under the hood.
... the with statement is not necessary anymore ..
todo: work towards asyncification and selenium 4
Whenever you encounter the daunted
from session not created: This version of ChromeDriver only supports Chrome version 96 # or what ever version
the solution is simple:
import undetected_chromedriver as uc
driver = uc.Chrome( version_main = 95 )July 2021: Currently busy implementing selenium 4 for undetected-chromedriver
newsflash: #255
To prevent unnecessary hair-pulling and issue-raising, please mind the important note at the end of this document .
Literally, this is all you have to do. Settings are included and your browser executable is found automagically. This is also the snippet i recommend using in case you experience an issue.
import undetected_chromedriver as uc
driver = uc.Chrome()
driver.get( 'https://nowsecure.nl' ) # my own test test site with max anti-bot protectionLiterally, this is all you have to do. If a specified folder does not exist, a NEW profile is created. Data dirs which are specified like this will not be autoremoved on exit.
import undetected_chromedriver as uc
options = uc.ChromeOptions()
# setting profile
options.user_data_dir = "c:\temp\profile"
# use specific (older) version
driver = uc.Chrome(
options = options , version_main = 94
) # version_main allows to specify your chrome version instead of following chrome global version
driver.get( 'https://nowsecure.nl' ) # my own test test site with max anti-bot protectionLiterally, this is all you have to do. You can now listen and subscribe to the low level devtools-protocol. I just recently found out that is also on planning for future release of the official chromedriver. However i implemented my own for now. Since i needed it myself for investigation.
