How do I automate data entry across a browser portal and a desktop app?

To automate data entry across a browser portal and a desktop application, you usually combine browser automation with desktop UI automation, and tie them together with a small orchestration script.

Common approaches

1) Browser portal automation

Use a browser automation tool like:

• Playwright (recommended)
• Selenium
• Puppeteer (mostly JavaScript)

These can:

• log in
• navigate pages
• fill forms
• click buttons
• extract data from tables or pages

2) Desktop app automation

Use a desktop automation tool like:

• pywinauto (Windows)
• AutoIt (Windows)
• Power Automate Desktop
• Robot Framework with desktop libraries
• Sikuli / image-based automation if the app has no accessible controls

These can:

• focus windows
• enter text into fields
• click menus/buttons
• read UI elements if the app exposes them

Best practice: use an end-to-end workflow

A typical setup is:

1. Read source data from a file/database/API
2. Enter or update data in the browser portal
3. Capture confirmation numbers / IDs
4. Switch to the desktop app
5. Enter the same or related data there
6. Log results and errors

Recommended stack

If you want something reliable and maintainable:

• Python for orchestration
• Playwright for web portal
• pywinauto or Power Automate Desktop for desktop app
• CSV/Excel/SQLite for input/output tracking
• Structured logging for auditability

Example architecture

Input file / database
        ↓
Python orchestrator
   ├─> Browser automation (Playwright)
   └─> Desktop automation (pywinauto)
        ↓
   Logs + error handling + retry

Example in Python

Very simplified example:

from playwright.sync_api import sync_playwright
# from pywinauto.application import Application

def update_portal(data):
    with sync_playwright() as p:
        browser = p.chromium.launch(headless=False)
        page = browser.new_page()
        page.goto("https://portal.example.com")
        page.fill("#username", "myuser")
        page.fill("#password", "mypassword")
        page.click("button[type=submit]")
        page.fill("#customer_name", data["name"])
        page.fill("#amount", str(data["amount"]))
        page.click("#save")
        browser.close()

def update_desktop_app(data):
    # Example only; actual selectors depend on the app
    # app = Application(backend="uia").connect(title="Desktop App")
    # window = app.window(title="Desktop App")
    # window.child_window(auto_id="CustomerName").set_text(data["name"])
    # window.child_window(auto_id="Amount").set_text(str(data["amount"]))
    # window.child_window(title="Save").click()
    pass

record = {"name": "Alice", "amount": 123.45}
update_portal(record)
update_desktop_app(record)

Important considerations

Reliability

• Prefer UI element selectors over coordinates
• Avoid image-based automation unless necessary
• Add retries and waits for dynamic screens

Security

• Don’t hardcode passwords
• Use a secrets manager or environment variables
• Be careful with PII and audit logs

Maintenance

• UI changes can break automation
• Keep selectors centralized
• Add screenshots or logs on failure

Compliance

Make sure automation is allowed by the portal’s terms and your organization’s policies.

If the desktop app is hard to automate

If it doesn’t expose controls well, you can:

• use keyboard navigation
• use OCR/image recognition
• ask the vendor for an API or command-line interface
• integrate through a database or file import/export if supported

Good next step

If you want, I can help you design the automation for your specific setup. Tell me:

• your browser portal tech, if known
• the desktop app type/OS
• whether you prefer Python, Power Automate, or something else
• what fields need to be transferred