Debugging CiviCRM cheatsheet » History » Version 39
Jon Goldberg, 12/07/2023 09:27 PM
1 | 7 | Jon Goldberg | {{last_updated_at}} by {{last_updated_by}} |
---|---|---|---|
2 | |||
3 | 1 | Jon Goldberg | # Debugging CiviCRM cheatsheet |
4 | |||
5 | ### Command-line runs of PHPUnit: |
||
6 | |||
7 | From a buildkit civiroot, run a specific file's tests:: |
||
8 | |||
9 | 2 | Jon Goldberg | ```shell |
10 | CIVICRM_UF=UnitTests phpunit5 tests/phpunit/CRM/Core/BAO/AddressTest.php |
||
11 | ``` |
||
12 | 1 | Jon Goldberg | |
13 | You can also limit to a single test by filtering on name: |
||
14 | |||
15 | 2 | Jon Goldberg | ```shell |
16 | CIVICRM_UF=UnitTests phpunit5 tests/phpunit/CRM/Core/BAO/AddressTest.php --filter testShared |
||
17 | ``` |
||
18 | 3 | Jon Goldberg | |
19 | ### With XDebug |
||
20 | 9 | Jon Goldberg | |
21 | 14 | Jon Goldberg | #### Web Browser |
22 | 37 | Brienne Kordis | * Install the xdebug extension (e.g. `sudo apt install php8.1-xdebug`). |
23 | * Configure xdebug by copying the values below to `/etc/php/8.1/fpm/conf.d/xdebug.ini`: |
||
24 | 2 | Jon Goldberg | |
25 | 1 | Jon Goldberg | ``` |
26 | 12 | Jon Goldberg | xdebug.mode=debug,develop |
27 | xdebug.start_with_request=trigger |
||
28 | 1 | Jon Goldberg | xdebug.client_port=9000 |
29 | xdebug.client_host = "127.0.0.1" |
||
30 | 10 | Jon Goldberg | xdebug.log=/var/log/xdebug.log |
31 | 12 | Jon Goldberg | #xdebug.mode=profile |
32 | 1 | Jon Goldberg | #xdebug.output_dir = "/home/jon/temp/xdebug" |
33 | ``` |
||
34 | 14 | Jon Goldberg | |
35 | 1 | Jon Goldberg | * Install a plugin for your browser, like "XDebug Helper for Firefox". |
36 | 14 | Jon Goldberg | * In the plugin's configuration, set the IDE key to `VSCODE`. |
37 | 37 | Brienne Kordis | * For buildkit sites, you'll need to cp the `xdebug.ini` into `apache2/fpm/conf.d` and `cli/fpm/conf.8`. Then restart apache and php |
38 | 14 | Jon Goldberg | |
39 | 22 | Brienne Kordis | * If one does not already exist, create a launch.json file within the .vscode folder (make a new folder if it does not yet exist) at the root of your codebase. What goes into the launch.json file depends on whether you are debugging a a site created with the `civibuild` command or one that was not built with that command. Here are examples of a [civibuild launch.json](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_civibuild_sites) and a [non-civibuild launch.json](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_non-civibuild_sites). Note that the "max-depth" on the "Listen for XDebug" configuration can be changed to delve deeper into the values that are returned (i.e. a depth of 6 will return more levels of a nested array than a depth of 3). |
40 | 19 | Brienne Kordis | |
41 | 14 | Jon Goldberg | To debug, you must turn on the debugger in VS Code, then enable debugging in the address bar for the requests in question. |
42 | |||
43 | 28 | Jon Goldberg | #### Web Browser - remote debugging |
44 | To debug on a remote server, ensure you have local debugging working first. |
||
45 | |||
46 | #### Server-side setup |
||
47 | * `sudo apt install php{{php_version}}-xdebug` (I should add this to `group_vars/all.yml` so it's everywhere). |
||
48 | 39 | Jon Goldberg | * Create a file `/etc/php/{{php_version}}/fpm/conf.d/xdebug.ini: |
49 | 28 | Jon Goldberg | |
50 | ``` |
||
51 | xdebug.mode=debug |
||
52 | xdebug.start_with_request=trigger |
||
53 | ``` |
||
54 | * Restart PHP. |
||
55 | |||
56 | #### Client side setup |
||
57 | * In your VS Code plugins screen, you need to select `Install in SSH` for the `PHP Debug` and `PHP Intelephense` plugins. |
||
58 | * Using the new **Remote Explorer** sidebar icon in VS Code, select the server you'd like to connect to. |
||
59 | * If you've already debugged on this site before, you should be able to expand the server and see a workspace file (see screenshot below). Click one of the connect icons. |
||
60 | * If you haven't debugged on this site before, follow *First Time* instructions below. Otherwise, debug as normal (make sure your Firefox "debug" icon is turned on). |
||
61 | |||
62 | ##### First Time |
||
63 | * Click **Open Folder** and navigate to the site's gitroot (usually the same as webroot, but for D8+ it's the folder above `web` so you can also debug in `vendor`). |
||
64 | * Select **File menu » Save Workspace As** and store a workspace file in your home directory. |
||
65 | 29 | Jon Goldberg | * Go to your **Extensions** sidebar, search for **php** and click **Install in SSH** next to *PHP Debug* and *PHP Intelephense*. |
66 | * For Drupal sites, also **Install in SSH** the *Drupal Syntax Highlighting* extension or you can't debug .module files. |
||
67 | * Go to the VS Code "debug" sidebar. Click **create a launch.json file** and then select **workspace**, then **PHP**. |
||
68 | 28 | Jon Goldberg | * (Optional) in the **Remote Explorer** sidebar, under the server you're connected to, right-click the entry that doesn't say "Workspace" in it and select **Remove from Recent List** to only keep workspace entries. |
69 | |||
70 | 18 | Jon Goldberg | #### civicrm-buildkit (mod_php) |
71 | The instructions above assume php-fpm. To also debug mod_php (e.g. civicrm-buildkit), do the following: |
||
72 | * Use the same configuration file as under "Web Browser", but at `/etc/php/7.4/apache2/conf.d/xdebug.ini`. |
||
73 | * Edit `/etc/php/7.4/apache2/conf.d/xdebug.ini` and change the client port from `9000` to `9001`. |
||
74 | |||
75 | 14 | Jon Goldberg | #### Command Line (phpunit) |
76 | |||
77 | 1 | Jon Goldberg | * You need to have XDebug otherwise configured for CLI. Use the same configuration file as under "Web Browser", but at `/etc/php/7.4/cli/conf.d/xdebug.ini`. |
78 | 15 | Jon Goldberg | * Also change `xdebug.mode=debug,develop` to avoid some unnecessary warning noise. |
79 | 14 | Jon Goldberg | |
80 | 5 | Jon Goldberg | * You need to start a debugging session in VS Code with "Listen for XDebug". |
81 | 1 | Jon Goldberg | * Depending on your VS Code setup, you may need to listen on a different port (I can use the same port for FPM but not mod_php). |
82 | 2 | Jon Goldberg | |
83 | Once you've got all that: |
||
84 | 1 | Jon Goldberg | ```shell |
85 | 15 | Jon Goldberg | env CIVICRM_UF=UnitTests XDEBUG_SESSION=VSCODE phpunit7 /home/jon/local/civicrm-buildkit/build/dmaster/web/sites/all/modules/civicrm/tests/phpunit/CRM/Core/BAO/ActionScheduleTest.php --filter testMembershipJoinDateMinutesUnit |
86 | 2 | Jon Goldberg | ``` |
87 | 6 | Jon Goldberg | |
88 | 30 | Jon Goldberg | #### phpunit for extensions: |
89 | This is for core extensions, I'll figure out (again) non-core extensions later. But from your civiroot: |
||
90 | ```shell |
||
91 | CIVICRM_UF=UnitTests phpunit8 --bootstrap ext/afform/mock/tests/phpunit/bootstrap.php ext/afform/mock/tests/phpunit/api/v4/AfformContactUsageTest.php |
||
92 | ``` |
||
93 | |||
94 | 31 | Jon Goldberg | For non-core extensions, from the extension's root folder. Note the use of `env XDEBUG_SESSION=VSCODE` for step debugging, and `--filter` to limit the tests run. |
95 | ``` |
||
96 | env XDEBUG_SESSION=VSCODE CIVICRM_UF=UnitTests phpunit8 --bootstrap tests/phpunit/bootstrap.php tests/phpunit/api/v3/Cdntaxreceipts/GenerateTest.php --filter testGenerate |
||
97 | ``` |
||
98 | |||
99 | 8 | Jon Goldberg | ### Command-line runs of standalone scripts |
100 | 6 | Jon Goldberg | ```shell |
101 | 13 | Jon Goldberg | env XDEBUG_SESSION=VSCODE php myscript.php |
102 | 6 | Jon Goldberg | ``` |
103 | 38 | Jon Goldberg | Also works for `cv`, probably `drush` and `wp` too: |
104 | ```shell |
||
105 | env XDEBUG_SESSION=VSCODE cv api NotificationLog.retry system_log_id=147597 |
||
106 | ``` |
||
107 | 16 | Jon Goldberg | |
108 | ### Debugging REST API calls in Ansible/curl |
||
109 | 17 | Jon Goldberg | Add an additional POST argument `XDEBUG_SESSION=VSCODE`. In curl, just add `-d 'XDEBUG_SESSION=VSCODE'` anywhere in your command. |
110 | |||
111 | For Ansible, this might look like: |
||
112 | 16 | Jon Goldberg | |
113 | ```yaml |
||
114 | - name: Shut up about Civi extensions (warnings only, 7 days) |
||
115 | uri: |
||
116 | url: "{{ primary_url }}/{{ endpoint }}" |
||
117 | method: POST |
||
118 | body: |
||
119 | XDEBUG_SESSION: VSCODE |
||
120 | entity: StatusPreference |
||
121 | action: create |
||
122 | json: "{{ {'name': 'checkExtensionsUpdates', 'ignore_severity': 3, 'hush_until': seven_days_hence } | to_json }}" |
||
123 | api_key: "{{ crm_api_key }}" |
||
124 | key: "{{ crm_site_key }}" |
||
125 | body_format: form-urlencoded |
||
126 | return_content: yes |
||
127 | ``` |
||
128 | 23 | Jon Goldberg | |
129 | ### Debugging in PHP `file_get_contents()` (e.g. `check_civicrm.php`) |
||
130 | Add `XDEBUG_SESSION=VSCODE` as a `GET` argument, it works even on a `POST` request. Pairs well with a remote debugging session. |
||
131 | e.g.: |
||
132 | ```php |
||
133 | $url = "$prot://$host_address/$path/System/check?XDEBUG_SESSION=VSCODE"; |
||
134 | ``` |
||
135 | 24 | Brienne Kordis | |
136 | ### Debugging JavaScript |
||
137 | |||
138 | While you can open up the Developer Tools on a browser (by right clicking on the window and then clicking **Inspect**) and debug the code directly there, it might be preferable to set up a debugging environment within an IDE, i.e. Visual Studio Code. To do so: |
||
139 | |||
140 | 27 | Brienne Kordis | 1. Open up your launch.json file (Need to set one up? There are [non-civibuild](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_non-civibuild_sites) and [Civibuild](https://hq.megaphonetech.com/projects/commons/wiki/Launchjson_for_civibuild_sites) options) |
141 | 24 | Brienne Kordis | 1. Within the `”configurations:”` array, add a comma after the last curly brace and then paste in: |
142 | |||
143 | ``` json |
||
144 | { |
||
145 | "type": "msedge", |
||
146 | "request": "attach", |
||
147 | "name": "Attach to browser", |
||
148 | "port": 9222 |
||
149 | } |
||
150 | ``` |
||
151 | * If you’d prefer to debug on chrome, use `”type”: “chrome”` |
||
152 | 1. Within your terminal, run the following command: |
||
153 | |||
154 | ```bash |
||
155 | 26 | Brienne Kordis | /usr/bin/google-chrome --remote-debugging-port=9222 –user-data-dir=remote-debug-profile |
156 | 24 | Brienne Kordis | ``` |
157 | * `/usr/bin/google-chrome` is the path of the Google Chrome Binary on Linux. For other operating systems, check out this [comment](https://forum.katalon.com/t/unknown-error-cannot-find-chrome-binary/9008/5), but note that the exact name might be different (i.e. google-chrome1 vs google-chrome). You can always `cd` through the path it recommends to find the exact match for either Chrome or MSEdge. |
||
158 | |||
159 | 1. Within VS Code, go to the Run and Debug tab, and from the drop down menu at the top, select “Attach to browser” and start the debugger. |
||
160 | * Note that the command given in the previous step is configured to open up a new browser, but these arguments (and more) can be customized. See the [documentation](https://code.visualstudio.com/docs/nodejs/browser-debugging#_launch-configuration-attributes) |
||
161 | |||
162 | 1. The new browser window (or tab, depending on your settings) is now configured to be the debuggee-yes, that’s the technical term- so you can set breakpoints and debug within VS Code! |
||
163 | 32 | Jon Goldberg | |
164 | ### Running Drupal 9+ tests |
||
165 | The [Mink setup](https://docs.civicrm.org/dev/en/latest/testing/mink/) instructions worked quite well. |
||
166 | I then also ran: |
||
167 | ``` |
||
168 | composer require drupal/webform |
||
169 | composer require drupal/webform_civicrm |
||
170 | 33 | Jon Goldberg | composer require drupal/token |
171 | 32 | Jon Goldberg | composer require semperit/minkcivicrmhelpers |
172 | ``` |
||
173 | 33 | Jon Goldberg | |
174 | Looking at CiviCARROT logs on the Webform-CiviCRM Github was helpful to figure those out. |
||
175 | 34 | Jon Goldberg | |
176 | For permissions reasons, you have to run as the www-data user (this is set up with `mod_php`, not `php-fpm`): |
||
177 | ```shell |
||
178 | zabuntu: ~/local/wfc-testing/web/core » sudo -u www-data ../../vendor/bin/phpunit -c ../../phpunit.xml ../modules/contrib/webform_civicrm/tests/src/FunctionalJavascript/ContributionPayLaterTest.php --filter testSubmitContribution |
||
179 | ``` |
||
180 | 35 | Brienne Kordis | |
181 | ### Finding an entry point to debug |
||
182 | If a better one can't be found in an error log/message, use these steps to start debugging: |
||
183 | 1. ssh into the server |
||
184 | 1. change to root user |
||
185 | 1. `cd /var/log/apache2` |
||
186 | 36 | Brienne Kordis | 1. `nano other_vhosts_access.log` |
187 | 35 | Brienne Kordis | 1. search for your IP address ( you can type "What's my IP address?" into Google if you don't know it) |
188 | 1. find the relevant line(s) with your IP address and grab the civicrm path from the url |
||
189 | 1. open up mysql (`cv sql`) and run `select * from civicrm_menu where path = '[civicrm path]';` |
||
190 | 36 | Brienne Kordis | 1. look at the access arguments, but we care most about the `page_callback` column which lists the civicrm class that is loaded at that path |
191 | 35 | Brienne Kordis | 1. open up that class in the codebase and use the buildForm hook as the entry point for debugging |