Compare commits

...
13 Commits
Author SHA1 Message Date
TZGyn 6a2c8df180 Modernize the result window UI
Restyles the window with a cleaner layout: icon-based toolbar buttons
(Copy/Save/Get All Text, highlighted OCR Selection action), a bottom status
bar with progress indicator and contextual hints, monospaced text tab, and
a divider separating chrome from content.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-13 09:40:51 +08:00
TZGyn c9447d2a8b Make Kapture screenshot-first with marquee text selection
The result window now works like a screenshot tool: drag on the image to
select a region, then click Get Selection Text to OCR only that area
(full-image OCR stays as Get All Text). Selection is rendered in image
coordinates so it stays accurate at any window size.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 21:06:09 +08:00
TZGyn 3fdc2fca95 Fix vertical offset when capturing the secondary display
The first ScreenCaptureKit Y-flip used the wrong reference edges, shifting
cropped selections on displays below the main screen. Convert each selection
per-display as scY = appKitY - NSScreen.maxY + SCDisplay.maxY, which
matches both the main and secondary displays.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:51:18 +08:00
TZGyn 590be2356f Fix captures on displays below the main screen
ScreenCaptureKit uses a flipped Y axis relative to AppKit NSScreen frames,
so selections on a display below the main screen produced out-of-bounds
crop rects and "Capture failed". Convert the selection into SCDisplay space
using the matching NSScreen's top edge before cropping.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:47:48 +08:00
TZGyn af32a36a91 Add Copy Diagnostics menu item for multi-display debugging
Prints each NSScreen's frame/backing scale/CG display ID and each
SCDisplay's frame/point size, and copies it to the clipboard, so
secondary-display capture failures can be debugged from the menu bar.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:44:56 +08:00
TZGyn 1327b61e2b Request capture pixels from the selection screen's backing scale
SCDisplay.width is in points, not pixels: the previous fix sent point
counts to SCStreamConfiguration, producing blurry main-screen captures and
failed secondary-screen captures. Multiply by the backing scale factor of
the screen containing the selection (defaulting to 1x, never forcing 2x).

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:37:53 +08:00
TZGyn c9a807e8a0 Fix secondary display captures after retina scaling change
The 1.1.2 retina fix overrode the stream width from the display's pixel
dimensions, which made captures on secondary monitors come out at the
wrong scale or offset. Restore requesting the display's native pixel
resolution and keep the crop scale derived from the actual returned image,
plus guard against out-of-bounds crop rects.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:34:18 +08:00
TZGyn 7bc93c2014 Anti-alias downscaled screenshots in the result window
Full-res retina captures are downscaled to fit the window; nearest-neighbor
made them look chunky. Use high-quality interpolation when shrinking, keep
pixel-crisp rendering only when upscaling small selections.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:25:23 +08:00
TZGyn 374af50acc Capture at full retina resolution
The ScreenCaptureKit stream was sized in points at 1x scale, so retina
displays produced half-resolution captures that appeared pixelated.
Request backingScale x pixels and derive the crop scale from the actual
captured image dimensions.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:14:39 +08:00
TZGyn 1a5771ec27 Render screenshot pixels crisply in the result window
The result image was upscaled with interpolated smoothing, making small
captures look low-res. Disable interpolation so pixels stay 1:1 sharp.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 16:07:42 +08:00
TZGyn 234a4226c5 Add notarization to release pipeline; sign with hardened runtime
release.sh now submits the zip to Apple's notary via notarytool, staples
the ticket, and repackages, so users no longer hit Gatekeeper warnings.
build-app.sh signs Developer ID builds with the hardened runtime and
unlocks the login keychain to avoid transient signing errors. The private
API key (.p8) is gitignored.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-12 11:31:14 +08:00
TZGyn af15f9a865 Add launch-at-login, multi-window results, and copy-image; auto-detect Developer ID
Users can now launch Kapture at login, keep multiple screenshot windows open
at once, and copy a screenshot to the clipboard. Builds sign with a Developer
ID identity when present, falling back to the ad-hoc self-signed key, so
Screen Recording permission survives rebuilds.

💘 Generated with Crush

Assisted-by: Crush:deepseek-v4-flash-0731
2026-08-11 21:55:04 +08:00
TZGyn 3f8d71b756 Document Homebrew installation in README 2026-08-11 11:26:51 +08:00
8 changed files with 582 additions and 73 deletions
+3
View File
@@ -5,6 +5,9 @@
# App bundle (build artifact, regenerate with ./build-app.sh) # App bundle (build artifact, regenerate with ./build-app.sh)
Kapture.app/ Kapture.app/
# Secrets
*.p8
# macOS # macOS
.DS_Store .DS_Store
+112
View File
@@ -0,0 +1,112 @@
# AGENTS.md
Kapture is a native macOS menu-bar screenshot + OCR app written in Swift/SwiftUI.
Single executable SwiftPM package, no external dependencies (all Apple frameworks).
## Architecture
Control flow for the main path: menu bar → hotkey → overlay → capture → result window → OCR.
- `Sources/Kapture/App.swift` — `@main` entry. `MenuBarExtra` menu, `AppDelegate`
(wires hotkey → `CaptureController.begin()`; handles `--test-ocr`), `PermissionManager`
(wraps `CGPreflightScreenCaptureAccess` / `CGRequestScreenCaptureAccess`).
- `Sources/Kapture/HotkeyManager.swift` — Carbon `RegisterEventHotKey`, hardcoded
⌘⇧S (`kVK_ANSI_S`, `cmdKey | shiftKey`), signature `0x4B505452`.
- `Sources/Kapture/CaptureController.swift` — selection flow. Creates one borderless
`NSPanel` overlay per screen, then captures via `ScreenCapture` and hands the image
to `ResultWindow`. Coordination happens in `begin()`/`finishSelection()`/`cancelSelection()`.
- `Sources/Kapture/ScreenCapture` (same file) — macOS 14+: ScreenCaptureKit
`SCScreenshotManager` + manual pixel-space crop (`display.width / display.frame.width`
scale); macOS 13: `CGWindowListCreateImage` fallback.
- `Sources/Kapture/OverlayView.swift` — `NSPanel` + `NSView` drawing overlay; mouse-driven
rect selection (min 2×2 pt), Escape (keyCode 53) cancels; selection committed via
`window.convertToScreen` (screen coordinates).
- `Sources/Kapture/OCRService.swift` — Vision `VNRecognizeTextRequest`, `.accurate`
level, languages `["en-US", "zh-Hans", "zh-Hant", "ja-JP", "ko-KR"]`. Custom
line-order sort: observations sorted top→bottom by `boundingBox.midY` (tolerance
`0.02`), then left→right. Runs on a private serial `DispatchQueue`
(`dev.tzgyn.kapture.ocr`), completes on that queue — callers must hop back to main.
- `Sources/Kapture/ResultWindow.swift` — `ResultWindow.show(image:)` (single shared
floating window, closes previous), `CaptureModel` (ObservableObject, `@Published`
`mode` = screenshot/text), `ResultView` (SwiftUI, Screenshot/Text tabs, Get Text /
Save PNG / Copy Text).
Singletons everywhere: `HotkeyManager.shared`, `CaptureController.shared`,
`ScreenCapture.shared`, `OCRService.shared`, `ResultWindow.shared`.
Note: packaging references `dev.tzgyn.kapture` as the bundle identifier — match this
in any new code (queue labels, TCC/plist references).
## Commands
```bash
swift build # debug build (also: swift run Kapture)
swift build -c release # release build (what build-app.sh uses)
swift run Kapture # dev run from terminal (app appears in Dock)
swift run Kapture --test-ocr # OCR smoke test: renders text, OCRs it, prints PASS/FAIL, exit 0/1
./build-app.sh # release build + Kapture.app bundle + icon + ad-hoc codesign
./release.sh <version> # e.g. ./release.sh 1.0.1: builds app, zips to dist/Kapture.zip, prints sha256
scripts/make-icon.sh # regenerates Kapture.app/Contents/Resources/Icon.icns from scripts/gen-icon.swift
```
There is no test target and no linter/formatter configured. Verification = build +
`--test-ocr`.
## Bundle build & signing
`build-app.sh` does: release build → handwritten `Info.plist` (NOT generated from
`Package.swift`) → `make-icon.sh` → `codesign` with self-signed identity `kapture-dev`
stored in a dedicated keychain at `~/.config/kapture/signing.keychain-db` (not the
login keychain). Honest bugs to keep in mind:
- Uses `security create-keychain`/`unlock-keychain` with a hardcoded password
(`kapture-dev`) — if the cert creation fails midway, the keychain may be left in an
undefined state; the script is mostly idempotent but re-run it before assuming failure.
- The self-signed cert is created with Homebrew OpenSSL (`/opt/homebrew/bin/openssl`,
falls back to `/usr/local/bin/openssl`, then system `openssl`) and imported as a
pkcs12 (`-export -legacy`). The legacy flag is important — modern OpenSSL defaults
to formats the macOS `security` tool rejects.
- `LSUIElement` = true → no Dock icon. Info.plist also hardcodes
`CFBundleShortVersionString` 1.0 / `CFBundleVersion` 1 — bump here for releases,
and match it in `release.sh` args.
macOS may require re-granting Screen Recording permission when the binary identity
changes (TCC tracks the binary, not the source).
## Release process
1. `./release.sh <version>` — builds, zips `Kapture.app` to `dist/Kapture.zip`,
prints its sha256 (that's all it does, it does not tag or upload).
2. Tag `git tag v<version> && git push origin v<version>` and attach the zip to a
GitHub release manually (the old `.github/workflows/release.yml` was removed;
`release.sh` output still says the workflow will upload the zip, which is stale).
3. The Homebrew cask lives in `TZGyn/homebrew-tap` — bump `version` and `sha256`
there for each release.
Icon note: the cask references the `Icon.icns` built into the app bundle, so no
separate icon release step needed.
## Gotchas
- Coordinate spaces differ: overlay selections are in global screen points
(via `convertToScreen`), ScreenCaptureKit images are in pixels and the crop must
scale by `display.width / display.frame.width`. Don't mix them.
- Starting on macOS 13 vs 14 changes the capture path: 13 uses the `CGWindowListCreateImage`
fallback, which only handles the primary screen (`frame.origin == .zero`) and
needs explicit Y-flip (`primary.frame.height - rect.maxY`). Get selection rect
handling wrong on one path and you break only one OS version — test on both.
- When selection overlays are active for more than one screen macOS may also be
capturing the overlay panels themselves while the selection is running; the overlay
windows' `windowNumber` IDs are collected in `begin()` and excluded via
`SCContentFilter(excludingWindows:)` when capturing. If you add any new window that
shows during overlay/selection, add it to the exclusion set.
- The OCR completion runs on a background queue — never touch `CaptureModel`/UI from
it; `runOCR` hops to `@MainActor` via `Task { @MainActor in ... }`.
- `--test-ocr` is processed in `AppDelegate.applicationDidFinishLaunching` and must
`exit()` with 0/1 inside the completion; the `RunLoop.main.run()` after is what keeps
the process alive until the async OCR finishes. If OCR returns empty text it
doesn't crash — just prints FAIL.
- No `@MainActor` annotations on AppDelegate / HotkeyManager; keep new code on main
thread for AppKit calls.
- `.gitignore` covers `.build/`, `Kapture.app/`, `dist/` — build artifacts should
never be committed.
+19
View File
@@ -13,6 +13,7 @@ No network calls, no API keys — everything runs locally.
- Global hotkey **⌘⇧S** works from any app - Global hotkey **⌘⇧S** works from any app
- Region selection overlay (all screens, Escape cancels) - Region selection overlay (all screens, Escape cancels)
- **Launch at Login** toggle in the menu bar
- The screenshot appears in a window (Screenshot / Text tabs) instead of being - The screenshot appears in a window (Screenshot / Text tabs) instead of being
instantly OCR'd instantly OCR'd
- **Get Text** button runs on-device OCR (English, Chinese simplified/traditional, - **Get Text** button runs on-device OCR (English, Chinese simplified/traditional,
@@ -21,6 +22,24 @@ No network calls, no API keys — everything runs locally.
- Open an existing image file (or drag) via the menu bar icon - Open an existing image file (or drag) via the menu bar icon
- Menu bar icon with permission status - Menu bar icon with permission status
## Install with Homebrew
```bash
brew tap TZGyn/tap
brew trust TZGyn/tap # Homebrew 6+ requires trusting third-party taps
brew install --cask kapture
```
Releases are published as zips on GitHub Releases; `release.sh` packages a
new one (`./release.sh 1.0.1 && git tag v1.0.1 && git push origin v1.0.1`).
The cask lives in the [TZGyn/homebrew-tap](https://github.com/TZGyn/homebrew-tap)
repository — bump the `version` and `sha256` there for each release.
Note: builds are ad-hoc signed (no App Store / Developer ID notarization), so
first launch of a new version may trigger a Gatekeeper warning — users can
right-click → Open, or the warning goes away when the binary identity matches a
previously-granted permission.
## Build & run ## Build & run
```bash ```bash
+41
View File
@@ -1,6 +1,7 @@
import SwiftUI import SwiftUI
import AppKit import AppKit
import CoreGraphics import CoreGraphics
import ServiceManagement
@main @main
struct KaptureApp: App { struct KaptureApp: App {
@@ -47,6 +48,26 @@ struct MenuView: View {
Divider() Divider()
Button("Copy Diagnostics") {
let diag = CaptureController.shared.diagnostics()
let pasteboard = NSPasteboard.general
pasteboard.clearContents()
pasteboard.setString(diag, forType: .string)
}
Button(LoginItem.isEnabled ? "Disable Launch at Login" : "Launch at Login") {
if !LoginItem.toggle() {
let alert = NSAlert()
alert.messageText = "Could not update Launch at Login"
alert.informativeText = "Launch at Login requires a signed app bundle in /Applications. It is not available when running via `swift run`."
alert.alertStyle = .warning
alert.addButton(withTitle: "OK")
alert.runModal()
}
}
Divider()
Button("Quit Kapture") { NSApp.terminate(nil) } Button("Quit Kapture") { NSApp.terminate(nil) }
.keyboardShortcut("q") .keyboardShortcut("q")
} }
@@ -60,6 +81,26 @@ enum PermissionManager {
} }
} }
enum LoginItem {
static var isEnabled: Bool {
SMAppService.mainApp.status == .enabled
}
static func toggle() -> Bool {
let service = SMAppService.mainApp
do {
if service.status == .enabled {
try service.unregister()
} else {
try service.register()
}
return true
} catch {
return false
}
}
}
func runOCRSelfTest() { func runOCRSelfTest() {
let text = "Kapture OCR test 1234, hello world" let text = "Kapture OCR test 1234, hello world"
let size = NSSize(width: 1600, height: 220) let size = NSSize(width: 1600, height: 220)
+67 -14
View File
@@ -10,6 +10,38 @@ final class CaptureController: NSObject {
private var previousApp: NSRunningApplication? private var previousApp: NSRunningApplication?
private var overlayIDs: [Int] = [] private var overlayIDs: [Int] = []
/// Diagnostic snapshot for "Copy Diagnostics" menu item.
func diagnostics() -> String {
var lines: [String] = []
lines.append("Kapture diagnostics")
for (i, s) in NSScreen.screens.enumerated() {
let scale = s.backingScaleFactor
let cgID = (s.deviceDescription[NSDeviceDescriptionKey("NSScreenNumber")] as? NSNumber)?.uint32Value ?? 0
lines.append("screen[\(i)]: frame=\(s.frame) scale=\(scale) backingSize=\(s.frame.width*scale)x\(s.frame.height*scale) cgID=\(cgID)")
}
if #available(macOS 14.0, *) {
Task {
if let content = try? await SCShareableContent.current {
for (i, d) in content.displays.enumerated() {
lines.append("SCDisplay[\(i)]: frame=\(d.frame) width=\(d.width)x\(d.height) id=\(d.displayID)")
}
} else {
lines.append("SCShareableContent: unavailable (no Screen Recording permission?)")
}
let text = lines.joined(separator: "\n")
let pb = NSPasteboard.general
pb.clearContents()
pb.setString(text, forType: .string)
}
} else {
let text = lines.joined(separator: "\n")
let pb = NSPasteboard.general
pb.clearContents()
pb.setString(text, forType: .string)
}
return lines.joined(separator: "\n")
}
func begin() { func begin() {
guard !isSelecting else { return } guard !isSelecting else { return }
guard PermissionManager.isGranted else { guard PermissionManager.isGranted else {
@@ -85,29 +117,31 @@ final class ScreenCapture {
private init() {} private init() {}
@available(macOS 14.0, *) @available(macOS 14.0, *)
private func crop(_ image: CGImage, to rect: NSRect, display: SCDisplay) -> CGImage? { private func crop(_ image: CGImage, to cgRect: CGRect, display: SCDisplay) -> CGImage? {
let scaleX = CGFloat(display.width) / display.frame.width // cgRect is already in SCDisplay space (Y flipped relative to AppKit).
let scaleY = CGFloat(display.height) / display.frame.height // Derive the pixel scale from the image we actually got, relative to
let cgRect = CGRect( // the display's point frame.
x: rect.minX, let scaleX = CGFloat(image.width) / display.frame.width
y: rect.minY, let scaleY = CGFloat(image.height) / display.frame.height
width: rect.width, guard scaleX > 0, scaleY > 0 else { return nil }
height: rect.height
)
let pxRect = CGRect( let pxRect = CGRect(
x: (cgRect.minX - display.frame.minX) * scaleX, x: (cgRect.minX - display.frame.minX) * scaleX,
y: (cgRect.minY - display.frame.minY) * scaleY, y: (cgRect.minY - display.frame.minY) * scaleY,
width: cgRect.width * scaleX, width: cgRect.width * scaleX,
height: cgRect.height * scaleY height: cgRect.height * scaleY
) )
// Guard against negative offsets when the selection reaches beyond the
// display's frame (e.g. secondary monitor coordinate quirks).
let safeRect = pxRect.intersection(CGRect(x: 0, y: 0, width: CGFloat(image.width), height: CGFloat(image.height)))
guard safeRect.width >= 1, safeRect.height >= 1 else { return nil }
guard let cropCtx = CGContext( guard let cropCtx = CGContext(
data: nil, width: Int(pxRect.width), height: Int(pxRect.height), data: nil, width: Int(safeRect.width), height: Int(safeRect.height),
bitsPerComponent: 8, bytesPerRow: 0, bitsPerComponent: 8, bytesPerRow: 0,
space: CGColorSpaceCreateDeviceRGB(), space: CGColorSpaceCreateDeviceRGB(),
bitmapInfo: CGImageAlphaInfo.premultipliedLast.rawValue bitmapInfo: CGImageAlphaInfo.premultipliedLast.rawValue
) else { return nil } ) else { return nil }
cropCtx.interpolationQuality = .high cropCtx.interpolationQuality = .high
cropCtx.draw(image, in: CGRect(x: -pxRect.minX, y: -pxRect.minY, width: CGFloat(image.width), height: CGFloat(image.height))) cropCtx.draw(image, in: CGRect(x: -safeRect.minX, y: -safeRect.minY, width: CGFloat(image.width), height: CGFloat(image.height)))
return cropCtx.makeImage() return cropCtx.makeImage()
} }
@@ -133,15 +167,34 @@ final class ScreenCapture {
let excluded = content.windows.filter { excludedSet.contains($0.windowID) } let excluded = content.windows.filter { excludedSet.contains($0.windowID) }
let filter = SCContentFilter(display: display, excludingWindows: excluded) let filter = SCContentFilter(display: display, excludingWindows: excluded)
let config = SCStreamConfiguration() let config = SCStreamConfiguration()
config.width = Int(display.width) // SCDisplay.width/height are in POINTS; SCStreamConfiguration
config.height = Int(display.height) // width/height are output PIXELS. Multiply by the backing scale
// of the screen containing the selection so retina displays are
// captured at full resolution and 1x displays stay 1x.
guard let screen = NSScreen.screens.first(where: { $0.frame.contains(NSPoint(x: rect.midX, y: rect.midY)) }) else {
completion(nil)
return
}
let backingScale = screen.backingScaleFactor
config.width = Int(CGFloat(display.width) * backingScale)
config.height = Int(CGFloat(display.height) * backingScale)
config.showsCursor = true config.showsCursor = true
// ScreenCaptureKit uses a different origin than AppKit for
// screens stacked around the main display: per-display,
// SCDisplay y = appKitY - NSScreen.maxY + SCDisplay.maxY.
let scRect = CGRect(
x: rect.minX,
y: rect.minY - screen.frame.maxY + display.frame.maxY,
width: rect.width,
height: rect.height
)
guard let image = try? await SCScreenshotManager.captureImage(contentFilter: filter, configuration: config) else { guard let image = try? await SCScreenshotManager.captureImage(contentFilter: filter, configuration: config) else {
completion(nil) completion(nil)
return return
} }
completion(self.crop(image, to: rect, display: display)) completion(self.crop(image, to: scRect, display: display))
} }
} else { } else {
guard let primary = NSScreen.screens.first(where: { $0.frame.origin == .zero }) ?? NSScreen.screens.first else { guard let primary = NSScreen.screens.first(where: { $0.frame.origin == .zero }) ?? NSScreen.screens.first else {
+236 -54
View File
@@ -5,24 +5,44 @@ import UniformTypeIdentifiers
final class ResultWindow { final class ResultWindow {
static let shared = ResultWindow() static let shared = ResultWindow()
private var window: NSWindow? private var windows: [NSWindow] = []
private var nextOrigin = NSPoint(x: 60, y: 60)
private var openCount = 0
@MainActor @MainActor
func show(image: CGImage) { func show(image: CGImage) {
window?.close()
let model = CaptureModel(image: image) let model = CaptureModel(image: image)
let hosting = NSHostingController(rootView: ResultView(model: model) { [weak self] in let w = NSWindow()
self?.window?.close() w.contentViewController = NSHostingController(rootView: ResultView(model: model) {
w.close()
}) })
let w = NSWindow(contentViewController: hosting) w.title = "Kapture — Screenshot" + (openCount > 0 ? " \(openCount + 1)" : "")
w.title = "Kapture — Screenshot"
w.level = .floating w.level = .floating
w.styleMask = [.titled, .closable, .resizable] w.styleMask = [.titled, .closable, .resizable]
w.setContentSize(NSSize(width: 694, height: 520)) w.setContentSize(NSSize(width: 694, height: 520))
w.isReleasedWhenClosed = false w.isReleasedWhenClosed = false
w.center() w.setFrameOrigin(nextOrigin)
w.makeKeyAndOrderFront(nil) w.makeKeyAndOrderFront(nil)
window = w
windows.append(w)
openCount += 1
nextOrigin = NSPoint(x: nextOrigin.x + 28, y: nextOrigin.y - 28)
windowCleanup(for: w)
}
private func windowCleanup(for window: NSWindow) {
NotificationCenter.default.addObserver(
forName: NSWindow.willCloseNotification,
object: window,
queue: .main
) { [weak self] _ in
Task { @MainActor in
guard let self else { return }
self.windows.removeAll { $0 === window }
self.openCount = max(0, self.openCount - 1)
}
}
} }
@MainActor @MainActor
@@ -68,6 +88,8 @@ final class CaptureModel: ObservableObject {
@Published var extractedText: String? @Published var extractedText: String?
@Published var isOCRRunning = false @Published var isOCRRunning = false
@Published var statusMessage: String? @Published var statusMessage: String?
/// Drag selection rect in IMAGE point space (nil = none)
@Published var selection: CGRect?
enum CaptureMode { enum CaptureMode {
case screenshot case screenshot
@@ -78,24 +100,43 @@ final class CaptureModel: ObservableObject {
self.image = image self.image = image
} }
var hasSelection: Bool { selection != nil && selection!.width >= 2 && selection!.height >= 2 }
var displayText: String { var displayText: String {
if isOCRRunning { if isOCRRunning {
return "Recognizing text…" return "Recognizing text…"
} }
return extractedText ?? "Text appears here — click “Get Text”." return extractedText ?? "Select text in the screenshot, then click “Get Text”."
} }
func runOCR() { func cropImage(to rectInImage: CGRect) -> CGImage? {
return image.cropping(to: rectInImage)
}
func runOCR(over selectionOnly: CGRect? = nil) {
guard !isOCRRunning else { return } guard !isOCRRunning else { return }
isOCRRunning = true isOCRRunning = true
statusMessage = nil statusMessage = nil
OCRService.shared.recognize(image) { [weak self] text in
let targetImage: CGImage
if let sel = selectionOnly {
guard let cropped = image.cropping(to: sel) else {
self.isOCRRunning = false
self.statusMessage = "Selection too small."
return
}
targetImage = cropped
} else {
targetImage = image
}
OCRService.shared.recognize(targetImage) { [weak self] text in
Task { @MainActor in Task { @MainActor in
guard let self else { return } guard let self else { return }
self.isOCRRunning = false self.isOCRRunning = false
self.mode = .text self.mode = .text
if text.isEmpty { if text.isEmpty {
self.extractedText = "No text found in the screenshot." self.extractedText = "No text found in the selection."
} else { } else {
self.extractedText = text self.extractedText = text
let pasteboard = NSPasteboard.general let pasteboard = NSPasteboard.general
@@ -107,6 +148,11 @@ final class CaptureModel: ObservableObject {
} }
} }
func runOCRSelection() {
guard let sel = selection, hasSelection else { return }
runOCR(over: sel)
}
func copyText() { func copyText() {
guard let text = extractedText else { return } guard let text = extractedText else { return }
let pasteboard = NSPasteboard.general let pasteboard = NSPasteboard.general
@@ -115,6 +161,13 @@ final class CaptureModel: ObservableObject {
statusMessage = "Copied to clipboard." statusMessage = "Copied to clipboard."
} }
func copyImage() {
let pasteboard = NSPasteboard.general
pasteboard.clearContents()
pasteboard.writeObjects([NSImage(cgImage: image, size: .zero)])
statusMessage = "Image copied to clipboard."
}
func savePNG() { func savePNG() {
let panel = NSSavePanel() let panel = NSSavePanel()
panel.allowedContentTypes = [.png] panel.allowedContentTypes = [.png]
@@ -144,67 +197,196 @@ struct ResultView: View {
let onClose: () -> Void let onClose: () -> Void
var body: some View { var body: some View {
VStack(spacing: 10) { VStack(spacing: 0) {
HStack { // Toolbar
HStack(spacing: 10) {
Picker("", selection: $model.mode) { Picker("", selection: $model.mode) {
Text("Screenshot").tag(CaptureModel.CaptureMode.screenshot) Text("Screenshot").tag(CaptureModel.CaptureMode.screenshot)
Text("Text").tag(CaptureModel.CaptureMode.text) Text("Text").tag(CaptureModel.CaptureMode.text)
if model.isOCRRunning {
Text("…").tag(CaptureModel.CaptureMode.text)
}
} }
.pickerStyle(.segmented) .pickerStyle(.segmented)
.fixedSize() .fixedSize()
Spacer()
Button("Save PNG…") { model.savePNG() }
Button("Get Text") { model.runOCR() }
.disabled(model.isOCRRunning || model.extractedText != nil)
Button("Close") { onClose() }
}
.padding(.horizontal, 12)
.padding(.top, 10)
Spacer()
if model.hasSelection {
Button {
model.runOCRSelection()
} label: {
Label("OCR Selection", systemImage: "text.magnifyingglass")
}
.buttonStyle(.borderedProminent)
.disabled(model.isOCRRunning)
.help("Recognize text inside the selected region")
}
Button {
model.runOCR()
} label: {
Label("Get All Text", systemImage: "text.viewfinder")
}
.buttonStyle(.bordered)
.disabled(model.isOCRRunning)
.help("Recognize all text in the screenshot")
Divider().frame(height: 18)
Button {
model.copyImage()
} label: {
Label("Copy", systemImage: "doc.on.doc")
}
.buttonStyle(.bordered)
.help("Copy image to clipboard")
Button {
model.savePNG()
} label: {
Label("Save", systemImage: "square.and.arrow.down")
}
.buttonStyle(.bordered)
.help("Save screenshot as PNG");
Button {
onClose()
} label: {
Image(systemName: "xmark.circle.fill")
.foregroundStyle(.secondary)
}
.buttonStyle(.plain)
.help("Close")
}
.padding(.horizontal, 14)
.padding(.vertical, 10)
Divider()
// Content
if model.mode == .screenshot { if model.mode == .screenshot {
Image(nsImage: NSImage(cgImage: model.image, size: .zero)) ScreenshotPane(model: model)
.resizable() .padding(12)
.aspectRatio(contentMode: .fit)
.border(Color.secondary.opacity(0.4))
.padding(.horizontal, 12)
} else { } else {
ZStack(alignment: .bottomTrailing) { ZStack {
ScrollView { ScrollView {
Text(model.displayText) Text(model.displayText)
.font(.system(.body)) .font(.system(.body, design: .monospaced))
.textSelection(.enabled) .textSelection(.enabled)
.frame(maxWidth: .infinity, alignment: .leading) .frame(maxWidth: .infinity, alignment: .leading)
.padding(8) .padding(12)
}
}
.frame(maxWidth: .infinity, maxHeight: .infinity)
} }
.overlay(
RoundedRectangle(cornerRadius: 6)
.stroke(Color.secondary.opacity(0.4))
)
// Status bar
HStack(spacing: 8) { HStack(spacing: 8) {
if let msg = model.statusMessage { if model.isOCRRunning {
Text(msg) ProgressView()
.controlSize(.small)
}
Text(model.statusMessage ?? (model.mode == .screenshot
? (model.hasSelection ? "Region selected — click OCR Selection." : "Drag to select a region, or Get All Text.")
: "Selectable text"))
.font(.caption) .font(.caption)
.foregroundColor(.secondary) .foregroundStyle(.secondary)
} .lineLimit(1)
Button("Copy Text") { model.copyText() }
}
.padding(8)
}
}
if model.statusMessage != nil && model.mode == .screenshot { Spacer()
Text(model.statusMessage!)
.font(.caption) if model.mode == .text, model.extractedText != nil {
.foregroundColor(.secondary) Button {
.frame(maxWidth: .infinity, alignment: .leading) model.copyText()
.padding(.horizontal, 12) } label: {
Label("Copy Text", systemImage: "doc.on.doc")
}
.buttonStyle(.bordered)
.controlSize(.small)
} }
} }
.padding(.bottom, 10) .padding(.horizontal, 14)
.frame(minWidth: 480, minHeight: 380) .padding(.vertical, 8)
.background(.bar)
}
.frame(minWidth: 520, minHeight: 420)
}
}
struct ScreenshotPane: View {
@ObservedObject var model: CaptureModel
private var imageSize: CGSize {
CGSize(width: model.image.width, height: model.image.height)
}
private func geometry(for geo: GeometryProxy) -> (scale: CGFloat, drawSize: CGSize, origin: CGPoint) {
let size = imageSize
let scale = min(geo.size.width / size.width, geo.size.height / size.height)
let drawSize = CGSize(width: size.width * scale, height: size.height * scale)
let origin = CGPoint(
x: (geo.size.width - drawSize.width) / 2,
y: (geo.size.height - drawSize.height) / 2
)
return (scale, drawSize, origin)
}
private func toImagePoint(_ viewPoint: CGPoint, scale: CGFloat, origin: CGPoint) -> CGPoint {
CGPoint(
x: (viewPoint.x - origin.x) / scale,
y: (viewPoint.y - origin.y) / scale
)
}
private func clampSelection(_ rect: CGRect) -> CGRect {
rect.intersection(CGRect(origin: .zero, size: imageSize))
}
var body: some View {
GeometryReader { geo in
let (scale, drawSize, origin) = geometry(for: geo)
ZStack {
Image(nsImage: NSImage(cgImage: model.image, size: .zero))
.resizable()
.interpolation(imageSize.width >= geo.size.width ? .high : .none)
.aspectRatio(contentMode: .fit)
.frame(width: drawSize.width, height: drawSize.height)
.position(x: origin.x + drawSize.width / 2, y: origin.y + drawSize.height / 2)
if let sel = model.selection {
let viewRect = CGRect(
x: origin.x + sel.minX * scale,
y: origin.y + sel.minY * scale,
width: sel.width * scale,
height: sel.height * scale
)
Rectangle()
.fill(Color.accentColor.opacity(0.15))
.border(Color.accentColor, width: 1.5)
.frame(width: viewRect.width, height: viewRect.height)
.position(x: viewRect.midX, y: viewRect.midY)
.allowsHitTesting(false)
}
}
.contentShape(Rectangle())
.gesture(
DragGesture(minimumDistance: 0)
.onChanged { value in
let start = toImagePoint(value.startLocation, scale: scale, origin: origin)
let current = toImagePoint(value.location, scale: scale, origin: origin)
let rect = CGRect(
x: min(start.x, current.x),
y: min(start.y, current.y),
width: abs(current.x - start.x),
height: abs(current.y - start.y)
)
model.selection = clampSelection(rect)
}
.onEnded { _ in
if let s = model.selection, (s.width < 2 || s.height < 2) {
model.selection = nil
}
}
)
}
} }
} }
+34 -4
View File
@@ -12,6 +12,28 @@ KEYCHAIN="$SIGN_DIR/signing.keychain-db"
KCHAIN_PASS="kapture-dev" KCHAIN_PASS="kapture-dev"
mkdir -p "$SIGN_DIR" mkdir -p "$SIGN_DIR"
# Prefer a Developer ID Application identity (login keychain) so the app gets
# clean Gatekeeper behavior; fall back to the self-signed "kapture-dev" identity.
# Resolve by keychain path to avoid ambiguous matches.
DEV_IDENT=""
if command -v security >/dev/null 2>&1; then
DEV_IDENT=$(security find-identity -v -p codesigning 2>/dev/null | awk '/Developer ID Application:/ { print $2; exit }')
fi
SIGN_KEYCHAIN=""
if [ -n "$DEV_IDENT" ]; then
CERT="$DEV_IDENT"
echo "Using Developer ID identity: $CERT"
# Ensure the login keychain holding the Dev ID is unlocked & accessible.
security unlock-keychain "$HOME/Library/Keychains/login.keychain-db" 2>/dev/null || true
security set-key-partition-list -S apple-tool:,apple:,codesign: -s -k "" "$HOME/Library/Keychains/login.keychain-db" >/dev/null 2>&1 || true
SIGN_KEYCHAIN="$HOME/Library/Keychains/login.keychain-db"
else
CERT="kapture-dev"
echo "Using self-signed identity 'kapture-dev'"
SIGN_KEYCHAIN="$KEYCHAIN"
fi
DEV_IDENT="${DEV_IDENT:-}" # ensure set for later use
if [ ! -f "$KEYCHAIN" ]; then if [ ! -f "$KEYCHAIN" ]; then
security create-keychain -p "$KCHAIN_PASS" "$KEYCHAIN" 2>/dev/null security create-keychain -p "$KCHAIN_PASS" "$KEYCHAIN" 2>/dev/null
security set-keychain-settings -lut 86400 "$KEYCHAIN" security set-keychain-settings -lut 86400 "$KEYCHAIN"
@@ -86,9 +108,9 @@ cat > "$APP/Contents/Info.plist" <<'PLIST'
<key>CFBundleIconFile</key> <key>CFBundleIconFile</key>
<string>Icon</string> <string>Icon</string>
<key>CFBundleShortVersionString</key> <key>CFBundleShortVersionString</key>
<string>1.0</string> <string>1.2.1</string>
<key>CFBundleVersion</key> <key>CFBundleVersion</key>
<string>1</string> <string>21</string>
<key>LSUIElement</key> <key>LSUIElement</key>
<true/> <true/>
<key>NSHighResolutionCapable</key> <key>NSHighResolutionCapable</key>
@@ -102,6 +124,14 @@ PLIST
chmod +x scripts/make-icon.sh chmod +x scripts/make-icon.sh
./scripts/make-icon.sh ./scripts/make-icon.sh
codesign --force --sign "$CERT" --keychain "$KEYCHAIN" "$APP" if [ -n "$SIGN_KEYCHAIN" ]; then
codesign --force --options runtime --sign "$CERT" --keychain "$SIGN_KEYCHAIN" "$APP"
else
codesign --force --sign "$CERT" "$APP"
fi
echo "Built $APP (signed with stable identity '$CERT') — drag to /Applications or run: open $APP" if [ -n "$DEV_IDENT" ]; then
echo "Built $APP (signed with Developer ID '$CERT') — drag to /Applications or run: open $APP"
else
echo "Built $APP (signed with stable identity '$CERT') — drag to /Applications or run: open $APP"
fi
+71 -2
View File
@@ -8,14 +8,83 @@ if [ "$#" -ne 1 ]; then
fi fi
VERSION="$1" VERSION="$1"
# Notarization credentials. Configure once, e.g. in ~/.zshrc:
# export KAPTURE_NOTARY_ASC_PROVIDER="<TeamID>"
# export KAPTURE_NOTARY_API_KEY_PATH="$HOME/.config/kapture/AuthKey_XXXX.p8"
# export KAPTURE_NOTARY_API_KEY_ID="<KeyID>"
# export KAPTURE_NOTARY_API_ISSUER="<IssuerID>"
# If these are unset (or KAPTURE_SKIP_NOTARY=1), release.sh builds, zips, and stops
# there — the zip is signed with the Developer ID identity but NOT notarized.
./build-app.sh ./build-app.sh
mkdir -p dist mkdir -p dist
rm -f dist/Kapture.zip rm -f dist/Kapture.zip
ditto -c -k --keepParent Kapture.app dist/Kapture.zip ditto -c -k --keepParent Kapture.app dist/Kapture.zip
shasum -a 256 dist/Kapture.zip
if [ -n "${KAPTURE_SKIP_NOTARY:-}" ]; then
echo
echo "Skipping notarization (KAPTURE_SKIP_NOTARY set)."
shasum -a 256 dist/Kapture.zip
echo
echo "Tag and release with:"
echo " git tag v$VERSION && git push origin v$VERSION"
echo "Attach dist/Kapture.zip to the GitHub release manually."
exit 0
fi
REQUIRED_VARS="KAPTURE_NOTARY_ASC_PROVIDER KAPTURE_NOTARY_API_KEY_PATH KAPTURE_NOTARY_API_KEY_ID KAPTURE_NOTARY_API_ISSUER"
MISSING=""
for v in $REQUIRED_VARS; do
if [ -z "${!v:-}" ]; then
MISSING="$MISSING $v"
fi
done
if [ -n "$MISSING" ]; then
echo "Notarization skipped — missing env var(s):$MISSING (see header comments)." >&2
shasum -a 256 dist/Kapture.zip
echo
echo "The zip above is signed but NOT notarized; Gatekeeper will warn users until it is."
echo "Set the KAPTURE_NOTARY_* variables and re-run ./release.sh $VERSION."
exit 0
fi
if ! command -v xcrun >/dev/null 2>&1 || ! xcrun --find notarytool >/dev/null 2>&1; then
echo "Notarization skipped — xcrun notarytool not found (requires Xcode 13+)." >&2
shasum -a 256 dist/Kapture.zip
exit 0
fi
echo "Submitting to Apple for notarization (first run can take minutes)..."
xcrun notarytool submit dist/Kapture.zip \
--key "$KAPTURE_NOTARY_API_KEY_PATH" \
--key-id "$KAPTURE_NOTARY_API_KEY_ID" \
--issuer "$KAPTURE_NOTARY_API_ISSUER" \
--wait \
--output-format json > notary-result.json
STATUS=$(jq -r '.status' notary-result.json 2>/dev/null || echo "unknown")
if [ "$STATUS" != "Accepted" ]; then
echo "Notarization failed with status: $STATUS" >&2
if [ -f notary-result.json ]; then
cat notary-result.json >&2
rm -f notary-result.json
fi
exit 1
fi
rm -f notary-result.json
echo "Notarization accepted — stapling ticket onto the app..."
xcrun stapler staple Kapture.app
xcrun stapler validate Kapture.app
rm -f dist/Kapture.zip
ditto -c -k --keepParent Kapture.app dist/Kapture.zip
echo
echo "Done — notarized."
shasum -a 256 dist/Kapture.zip
echo echo
echo "Tag and release with:" echo "Tag and release with:"
echo " git tag v$VERSION && git push origin v$VERSION" echo " git tag v$VERSION && git push origin v$VERSION"
echo "The GitHub Actions release workflow will upload dist/Kapture.zip automatically." echo "Attach dist/Kapture.zip to the GitHub release manually; the Homebrew cask is ready."